Aug 26 13:06:54 user nova-compute[73503]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 13:06:57 user nova-compute[73503]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73503) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73503) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73503) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 13:06:57 user nova-compute[73503]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:06:57 user nova-compute[73503]: INFO nova.virt.driver [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 13:06:57 user nova-compute[73503]: INFO nova.compute.provider_config [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Acquiring lock "singleton_lock" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Acquired lock "singleton_lock" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Releasing lock "singleton_lock" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Full set of CONF: {{(pid=73503) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ******************************************************************************** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Configuration options gathered from: {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ================================================================================ {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] allow_resize_to_same_host      = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] arq_binding_timeout            = 300 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] backdoor_port                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] backdoor_socket                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] block_device_allocate_retries  = 300 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] block_device_allocate_retries_interval = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cert                           = self.pem {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute_monitors               = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] config_dir                     = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] config_drive_format            = iso9660 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] config_source                  = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] console_host                   = user {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] control_exchange               = nova {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cpu_allocation_ratio           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] daemon                         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] debug                          = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] default_access_ip_network_name = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] default_availability_zone      = nova {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] default_ephemeral_format       = ext4 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] default_green_pool_size        = 1000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] default_schedule_zone          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] disk_allocation_ratio          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] enable_new_services            = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] enabled_ssl_apis               = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] flat_injected                  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] force_config_drive             = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] force_raw_images               = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] graceful_shutdown_timeout      = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] heal_instance_info_cache_interval = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] host                           = user {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_build_timeout         = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_delete_interval       = 300 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_name_template         = instance-%08x {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_usage_audit           = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_usage_audit_period    = month {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:57 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] internal_service_availability_zone = internal {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] key                            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] live_migration_retry_count     = 30 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_config_append              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_dir                        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_file                       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_options                    = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_rotate_interval            = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_rotate_interval_type       = days {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] log_rotation_type              = none {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] long_rpc_timeout               = 1800 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] max_concurrent_builds          = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] max_concurrent_live_migrations = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] max_concurrent_snapshots       = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] max_local_block_devices        = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] max_logfile_count              = 30 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] max_logfile_size_mb            = 200 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] maximum_instance_delete_attempts = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metadata_listen                = 0.0.0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metadata_listen_port           = 8775 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metadata_workers               = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] migrate_max_retries            = -1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] mkisofs_cmd                    = genisoimage {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] my_ip                          = 10.0.0.210 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] network_allocate_retries       = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] osapi_compute_listen_port      = 8774 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] osapi_compute_unique_server_name_scope =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] osapi_compute_workers          = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] password_length                = 12 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] periodic_enable                = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] periodic_fuzzy_delay           = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] pointer_model                  = ps2mouse {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] preallocate_images             = none {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] publish_errors                 = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] pybasedir                      = /opt/stack/nova {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ram_allocation_ratio           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rate_limit_burst               = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rate_limit_except_level        = CRITICAL {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rate_limit_interval            = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reboot_timeout                 = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reclaim_instance_interval      = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] record                         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reimage_timeout_per_gb         = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] report_interval                = 120 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rescue_timeout                 = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reserved_host_cpus             = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reserved_host_disk_mb          = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reserved_host_memory_mb        = 512 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] reserved_huge_pages            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] resize_confirm_window          = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] resize_fs_using_block_device   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] resume_guests_state_on_host_boot = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rpc_response_timeout           = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] run_external_periodic_tasks    = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] running_deleted_instance_action = reap {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] running_deleted_instance_timeout = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler_instance_sync_interval = 120 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_down_time              = 720 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] servicegroup_driver            = db {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] shelved_offload_time           = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] shelved_poll_interval          = 3600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] shutdown_timeout               = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] source_is_ipv6                 = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ssl_only                       = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] state_path                     = /opt/stack/data/nova {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] sync_power_state_interval      = 600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] sync_power_state_pool_size     = 1000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] syslog_log_facility            = LOG_USER {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] tempdir                        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] timeout_nbd                    = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] transport_url                  = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] update_resources_interval      = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_cow_images                 = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_eventlog                   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_journal                    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_json                       = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_rootwrap_daemon            = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_stderr                     = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] use_syslog                     = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vcpu_pin_set                   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plugging_is_fatal          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plugging_timeout           = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] virt_mkfs                      = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] volume_usage_poll_interval     = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] watch_log_file                 = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] web                            = /usr/share/spice-html5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.auth_strategy              = keystone {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.compute_link_prefix        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.dhcp_domain                = novalocal {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.enable_instance_password   = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.glance_link_prefix         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.instance_list_per_project_cells = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.list_records_by_skipping_down_cells = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.local_metadata_per_cell    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.max_limit                  = 1000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.metadata_cache_expiration  = 15 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.neutron_default_tenant_id  = default {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.use_forwarded_for          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.use_neutron_default_nets   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_dynamic_targets = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_jsonfile_path   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.backend_argument         = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.config_prefix            = cache.oslo {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.dead_timeout             = 60.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.debug_cache_backend      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.enable_retry_client      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.enable_socket_keepalive  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.enabled                  = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.expiration_time          = 600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_dead_retry      = 300 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_password        =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_sasl_enabled    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.memcache_username        =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.proxies                  = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.retry_attempts           = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.retry_delay              = 0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.socket_keepalive_count   = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.socket_keepalive_idle    = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.socket_keepalive_interval = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.tls_allowed_ciphers      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.tls_cafile               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.tls_certfile             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.tls_enabled              = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cache.tls_keyfile              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.auth_section            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.auth_type               = password {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.cafile                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.certfile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.collect_timing          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.cross_az_attach         = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.debug                   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.endpoint_template       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.http_retries            = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.insecure                = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.keyfile                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.os_region_name          = RegionOne {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.split_loggers           = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cinder.timeout                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.cpu_dedicated_set      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.cpu_shared_set         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.image_type_exclude_list = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.resource_provider_association_refresh = 300 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.shutdown_retry_interval = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] conductor.workers              = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] console.allowed_origins        = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] console.ssl_ciphers            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] console.ssl_minimum_version    = default {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] consoleauth.token_ttl          = 600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.cafile                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.certfile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.collect_timing          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.connect_retries         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.connect_retry_delay     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.endpoint_override       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.insecure                = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.keyfile                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.max_version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.min_version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.region_name             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.service_name            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.service_type            = accelerator {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.split_loggers           = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.status_code_retries     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.timeout                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] cyborg.version                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.backend               = sqlalchemy {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.connection            = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.connection_debug      = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.connection_parameters =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.connection_recycle_time = 3600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.connection_trace      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.db_inc_retry_interval = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.db_max_retries        = 20 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.db_max_retry_interval = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.db_retry_interval     = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.max_overflow          = 50 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.max_pool_size         = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.max_retries           = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.mysql_enable_ndb      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.pool_timeout          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.retry_interval        = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.slave_connection      = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] database.sqlite_synchronous    = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.backend           = sqlalchemy {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.connection        = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.connection_debug  = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.connection_parameters =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.connection_recycle_time = 3600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.connection_trace  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.db_inc_retry_interval = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.db_max_retries    = 20 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.db_max_retry_interval = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.db_retry_interval = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.max_overflow      = 50 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.max_pool_size     = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.max_retries       = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.mysql_enable_ndb  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.pool_timeout      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.retry_interval    = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.slave_connection  = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] api_database.sqlite_synchronous = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] devices.enabled_mdev_types     = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ephemeral_storage_encryption.enabled = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.api_servers             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.cafile                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.certfile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.collect_timing          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.connect_retries         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.connect_retry_delay     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.debug                   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.default_trusted_certificate_ids = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.enable_certificate_validation = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.enable_rbd_download     = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.endpoint_override       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.insecure                = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.keyfile                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.max_version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.min_version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.num_retries             = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.rbd_ceph_conf           =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.rbd_connect_timeout     = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.rbd_pool                =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.rbd_user                =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.region_name             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.service_name            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.service_type            = image {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.split_loggers           = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.status_code_retries     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.timeout                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.verify_glance_signatures = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] glance.version                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] guestfs.debug                  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.config_drive_cdrom      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.config_drive_inject_password = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.enable_remotefx         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.instances_path_share    =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.limit_cpu_features      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.use_multipath_io        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.vswitch_name            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] mks.enabled                    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] image_cache.manager_interval   = 2400 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] image_cache.precache_concurrency = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] image_cache.remove_unused_base_images = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] image_cache.subdirectory_name  = _base {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.api_max_retries         = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.api_retry_interval      = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.auth_section            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.auth_type               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.cafile                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.certfile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.collect_timing          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.connect_retries         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.connect_retry_delay     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.endpoint_override       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.insecure                = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.keyfile                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.max_version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.min_version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.partition_key           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.peer_list               = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.region_name             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.serial_console_state_timeout = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.service_name            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.service_type            = baremetal {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.split_loggers           = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.status_code_retries     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.timeout                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ironic.version                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] key_manager.fixed_key          = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.barbican_api_version  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.barbican_endpoint     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.barbican_endpoint_type = public {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.barbican_region_name  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.cafile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.certfile              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.collect_timing        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.insecure              = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.keyfile               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.number_of_retries     = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.retry_delay           = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.send_service_user_token = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.split_loggers         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.timeout               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.verify_ssl            = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican.verify_ssl_path       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.auth_section = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.auth_type = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.cafile   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.certfile = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.collect_timing = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.insecure = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.keyfile  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.split_loggers = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] barbican_service_user.timeout  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.approle_role_id          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.approle_secret_id        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.cafile                   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.certfile                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.collect_timing           = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.insecure                 = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.keyfile                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.kv_mountpoint            = secret {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.kv_version               = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.namespace                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.root_token_id            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.split_loggers            = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.ssl_ca_crt_file          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.timeout                  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.use_ssl                  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.cafile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.certfile              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.collect_timing        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.connect_retries       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.connect_retry_delay   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.endpoint_override     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.insecure              = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.keyfile               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.max_version           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.min_version           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.region_name           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.service_name          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.service_type          = identity {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.split_loggers         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.status_code_retries   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.timeout               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] keystone.version               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.connection_uri         =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_mode               = custom {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: WARNING oslo_config.cfg [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_power_governor_high = performance {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_power_management   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.device_detach_attempts = 8 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.device_detach_timeout  = 20 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.disk_cachemodes        = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.disk_prefix            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.enabled_perf_events    = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.file_backed_memory     = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.gid_maps               = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.hw_disk_discard        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.hw_machine_type        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_rbd_pool        = rbd {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_type            = default {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.images_volume_group    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.inject_key             = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.inject_partition       = -2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.inject_password        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.iscsi_iface            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.iser_use_multipath     = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_downtime = 500 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_inbound_addr = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_scheme  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_timeout_action = abort {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_tunnelled = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: WARNING oslo_config.cfg [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 13:06:58 user nova-compute[73503]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 13:06:58 user nova-compute[73503]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 13:06:58 user nova-compute[73503]: and ``live_migration_inbound_addr`` respectively.
Aug 26 13:06:58 user nova-compute[73503]: ).  Its value may be silently ignored in the future.
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.live_migration_with_native_tls = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.max_queues             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.nfs_mount_options      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.num_pcie_ports         = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.pmem_namespaces        = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.quobyte_client_cfg     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rbd_secret_uuid        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rbd_user               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rescue_image_id        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rescue_kernel_id       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.rx_queue_size          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.smbfs_mount_options    =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.snapshot_compression   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.snapshot_image_format  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.sparse_logical_volumes = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.swtpm_enabled          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.swtpm_group            = tss {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.swtpm_user             = tss {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.sysinfo_serial         = unique {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.tb_cache_size          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.tx_queue_size          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.uid_maps               = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.use_virtio_for_bridges = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.virt_type              = kvm {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.volume_clear           = zero {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.volume_clear_size      = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.volume_use_multipath   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_cache_path   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.auth_section           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.auth_type              = password {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.cafile                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.certfile               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.collect_timing         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.connect_retries        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.connect_retry_delay    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.default_floating_pool  = public {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.endpoint_override      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.extension_sync_interval = 600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.http_retries           = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.insecure               = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.keyfile                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.max_version            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.min_version            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.ovs_bridge             = br-int {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.physnets               = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.region_name            = RegionOne {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.service_metadata_proxy = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.service_name           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.service_type           = network {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.split_loggers          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.status_code_retries    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.timeout                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] neutron.version                = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] notifications.bdms_in_notifications = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] notifications.default_level    = INFO {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] notifications.notification_format = unversioned {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] notifications.notify_on_state_change = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] pci.alias                      = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] pci.device_spec                = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] pci.report_in_placement        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.auth_section         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.auth_type            = password {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.cafile               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.certfile             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.collect_timing       = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.connect_retries      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.connect_retry_delay  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.default_domain_id    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.default_domain_name  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.domain_id            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.domain_name          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.endpoint_override    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.insecure             = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.keyfile              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.max_version          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.min_version          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.password             = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.project_domain_id    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.project_domain_name  = Default {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.project_id           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.project_name         = service {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.region_name          = RegionOne {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.service_name         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.service_type         = placement {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.split_loggers        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.status_code_retries  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.system_scope         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.timeout              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.trust_id             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.user_domain_id       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.user_domain_name     = Default {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.user_id              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.username             = placement {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] placement.version              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.cores                    = 20 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.count_usage_from_placement = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.injected_file_content_bytes = 10240 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.injected_file_path_length = 255 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.injected_files           = 5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.instances                = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.key_pairs                = 100 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.metadata_items           = 128 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.ram                      = 51200 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.recheck_quota            = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.server_group_members     = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] quota.server_groups            = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rdp.enabled                    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.image_metadata_prefilter = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.max_attempts         = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.max_placement_results = 1000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] scheduler.workers              = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.host_subset_size = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.isolated_hosts = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.isolated_images = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.pci_in_placement = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.track_instance_changes = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metrics.required               = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metrics.weight_multiplier      = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] metrics.weight_setting         = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] serial_console.enabled         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] serial_console.port_range      = 10000:20000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] serial_console.serialproxy_port = 6083 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.auth_section      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.auth_type         = password {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.cafile            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.certfile          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.collect_timing    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.insecure          = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.keyfile           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.send_service_user_token = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.split_loggers     = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] service_user.timeout           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.agent_enabled            = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.enabled                  = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.html5proxy_port          = 6082 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.image_compression        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.jpeg_compression         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.playback_compression     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.server_listen            = 127.0.0.1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.streaming_mode           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] spice.zlib_compression         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] upgrade_levels.baseapi         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] upgrade_levels.cert            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] upgrade_levels.compute         = auto {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] upgrade_levels.conductor       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] upgrade_levels.scheduler       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.cafile = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.certfile = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.insecure = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vendordata_dynamic_auth.timeout = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.api_retry_count         = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.ca_file                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.cache_prefix            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.cluster_name            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.connection_pool_size    = 10 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.console_delay_seconds   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.datastore_regex         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.host_ip                 = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.host_password           = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.host_port               = 443 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.host_username           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.insecure                = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.integration_bridge      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.maximum_objects         = 100 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.pbm_default_policy      = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.pbm_enabled             = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.pbm_wsdl_location       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.serial_port_proxy_uri   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.serial_port_service_uri = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.task_poll_interval      = 0.5 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.use_linked_clone        = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.vnc_keymap              = en-us {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.vnc_port                = 5900 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vmware.vnc_port_total          = 10000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.auth_schemes               = ['none'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.enabled                    = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.novncproxy_port            = 6080 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.vencrypt_ca_certs          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.vencrypt_client_cert       = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vnc.vencrypt_client_key        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.disable_rootwrap   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.enable_numa_live_migration = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.libvirt_disable_apic = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.client_socket_timeout     = 900 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.default_pool_size         = 1000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.keep_alive                = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.max_header_line           = 16384 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.ssl_ca_file               = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.ssl_cert_file             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.ssl_key_file              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.tcp_keepidle              = 600 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] zvm.ca_file                    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] zvm.cloud_connector_url        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] zvm.reachable_timeout          = 300 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.enforce_new_defaults = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.enforce_scope      = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.policy_default_rule = default {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.connection_string     = messaging:// {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.enabled               = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.es_doc_type           = notification {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.es_scroll_size        = 10000 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.es_scroll_time        = 2m {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.filter_error_trace    = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.hmac_keys             = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.sentinel_service_name = mymaster {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.socket_timeout        = 0.1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.trace_requests        = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler.trace_sqlalchemy      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler_jaeger.process_tags   = {} {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] profiler_otlp.service_name_prefix = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] remote_debug.host              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] remote_debug.port              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.auth_section        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.auth_type           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.cafile              = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.certfile            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.collect_timing      = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.connect_retries     = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.connect_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.endpoint_id         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.endpoint_override   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.insecure            = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.keyfile             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.max_version         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.min_version         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.region_name         = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.service_name        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.service_type        = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.split_loggers       = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.status_code_retries = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.status_code_retry_delay = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.timeout             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.valid_interfaces    = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_limit.version             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_reports.file_event_handler = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] oslo_reports.log_dir           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_ovs_privileged.group  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] vif_plug_ovs_privileged.user   = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_ovs.isolate_vif         = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] os_brick.lock_path             = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] privsep_osbrick.capabilities   = [21] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] privsep_osbrick.group          = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] privsep_osbrick.helper_command = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] privsep_osbrick.user           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] nova_sys_admin.group           = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] nova_sys_admin.helper_command  = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] nova_sys_admin.user            = None {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG oslo_service.service [None req-9841b1e3-0ff2-4a2a-8e92-0543d4f552b2 None None] ******************************************************************************** {{(pid=73503) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 13:06:58 user nova-compute[73503]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Starting native event thread {{(pid=73503) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Starting green dispatch thread {{(pid=73503) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Starting connection event dispatch thread {{(pid=73503) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Connecting to libvirt: qemu:///system {{(pid=73503) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd31d8fe7a0> {{(pid=73503) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd31d8fe7a0> {{(pid=73503) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 13:06:58 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Connection event '1' reason 'None'
Aug 26 13:06:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 13:06:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.mount [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Initialising _HostMountState generation 0 {{(pid=73503) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 13:07:06 user nova-compute[73503]: INFO nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host capabilities <capabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <host>
Aug 26 13:07:06 user nova-compute[73503]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 13:07:06 user nova-compute[73503]:     <cpu>
Aug 26 13:07:06 user nova-compute[73503]:       <arch>x86_64</arch>
Aug 26 13:07:06 user nova-compute[73503]:       <model>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <microcode version='1070'/>
Aug 26 13:07:06 user nova-compute[73503]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='osxsave'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='invtsc'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='rsba'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 13:07:06 user nova-compute[73503]:       <pages unit='KiB' size='4'/>
Aug 26 13:07:06 user nova-compute[73503]:       <pages unit='KiB' size='2048'/>
Aug 26 13:07:06 user nova-compute[73503]:     </cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <power_management>
Aug 26 13:07:06 user nova-compute[73503]:       <suspend_mem/>
Aug 26 13:07:06 user nova-compute[73503]:       <suspend_disk/>
Aug 26 13:07:06 user nova-compute[73503]:       <suspend_hybrid/>
Aug 26 13:07:06 user nova-compute[73503]:     </power_management>
Aug 26 13:07:06 user nova-compute[73503]:     <iommu support='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <migration_features>
Aug 26 13:07:06 user nova-compute[73503]:       <live/>
Aug 26 13:07:06 user nova-compute[73503]:       <uri_transports>
Aug 26 13:07:06 user nova-compute[73503]:         <uri_transport>tcp</uri_transport>
Aug 26 13:07:06 user nova-compute[73503]:         <uri_transport>rdma</uri_transport>
Aug 26 13:07:06 user nova-compute[73503]:       </uri_transports>
Aug 26 13:07:06 user nova-compute[73503]:     </migration_features>
Aug 26 13:07:06 user nova-compute[73503]:     <topology>
Aug 26 13:07:06 user nova-compute[73503]:       <cells num='2'>
Aug 26 13:07:06 user nova-compute[73503]:         <cell id='0'>
Aug 26 13:07:06 user nova-compute[73503]:           <memory unit='KiB'>8189224</memory>
Aug 26 13:07:06 user nova-compute[73503]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 13:07:06 user nova-compute[73503]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 13:07:06 user nova-compute[73503]:           <distances>
Aug 26 13:07:06 user nova-compute[73503]:             <sibling id='0' value='10'/>
Aug 26 13:07:06 user nova-compute[73503]:             <sibling id='1' value='20'/>
Aug 26 13:07:06 user nova-compute[73503]:           </distances>
Aug 26 13:07:06 user nova-compute[73503]:           <cpus num='6'>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 13:07:06 user nova-compute[73503]:           </cpus>
Aug 26 13:07:06 user nova-compute[73503]:         </cell>
Aug 26 13:07:06 user nova-compute[73503]:         <cell id='1'>
Aug 26 13:07:06 user nova-compute[73503]:           <memory unit='KiB'>8206460</memory>
Aug 26 13:07:06 user nova-compute[73503]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 13:07:06 user nova-compute[73503]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 13:07:06 user nova-compute[73503]:           <distances>
Aug 26 13:07:06 user nova-compute[73503]:             <sibling id='0' value='20'/>
Aug 26 13:07:06 user nova-compute[73503]:             <sibling id='1' value='10'/>
Aug 26 13:07:06 user nova-compute[73503]:           </distances>
Aug 26 13:07:06 user nova-compute[73503]:           <cpus num='6'>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 13:07:06 user nova-compute[73503]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 13:07:06 user nova-compute[73503]:           </cpus>
Aug 26 13:07:06 user nova-compute[73503]:         </cell>
Aug 26 13:07:06 user nova-compute[73503]:       </cells>
Aug 26 13:07:06 user nova-compute[73503]:     </topology>
Aug 26 13:07:06 user nova-compute[73503]:     <cache>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 13:07:06 user nova-compute[73503]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 13:07:06 user nova-compute[73503]:     </cache>
Aug 26 13:07:06 user nova-compute[73503]:     <secmodel>
Aug 26 13:07:06 user nova-compute[73503]:       <model>apparmor</model>
Aug 26 13:07:06 user nova-compute[73503]:       <doi>0</doi>
Aug 26 13:07:06 user nova-compute[73503]:     </secmodel>
Aug 26 13:07:06 user nova-compute[73503]:     <secmodel>
Aug 26 13:07:06 user nova-compute[73503]:       <model>dac</model>
Aug 26 13:07:06 user nova-compute[73503]:       <doi>0</doi>
Aug 26 13:07:06 user nova-compute[73503]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 13:07:06 user nova-compute[73503]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 13:07:06 user nova-compute[73503]:     </secmodel>
Aug 26 13:07:06 user nova-compute[73503]:   </host>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='alpha'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>clipper</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='armv6l'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>spitz</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>nuri</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>kzm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sx1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>z2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>tosa</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>n810</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>n800</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>terrier</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>midway</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>microbit</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>verdex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>highbank</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>akita</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>connex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>collie</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='armv7l'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>spitz</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>nuri</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>kzm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sx1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>z2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>tosa</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>n810</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>n800</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>terrier</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>midway</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>microbit</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>verdex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>highbank</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>akita</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>connex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>collie</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='aarch64'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>spitz</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>nuri</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>kzm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sx1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>z2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>tosa</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>n810</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>n800</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>terrier</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>midway</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>microbit</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>verdex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>highbank</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>akita</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>connex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>collie</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <acpi default='on' toggle='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='cris'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='i686'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>isapc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>microvm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='kvm'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <pae/>
Aug 26 13:07:06 user nova-compute[73503]:       <nonpae/>
Aug 26 13:07:06 user nova-compute[73503]:       <acpi default='on' toggle='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:       <apic default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='m68k'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>an5206</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>q800</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='microblaze'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='microblazeel'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='mips'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='16'>malta</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='mipsel'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='16'>malta</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='mips64'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='16'>malta</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>pica61</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>magnum</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='mips64el'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='16'>malta</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>pica61</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>magnum</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='16'>boston</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='ppc'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mac99</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>40p</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>taihu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='ppc64'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>taihu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>40p</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mac99</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='ppc64le'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>taihu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>40p</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>mac99</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='riscv32'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='8'>spike</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='8'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='riscv64'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='8'>spike</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='8'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='s390x'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='sh4'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>shix</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>r2d</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='sh4eb'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>shix</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>r2d</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='sparc'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>LX</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='sparc64'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>niagara</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='x86_64'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>64</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='1'>isapc</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>microvm</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='kvm'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <acpi default='on' toggle='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:       <apic default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='xtensa'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>sim</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>kc705</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ml605</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx200</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx60</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]:   <guest>
Aug 26 13:07:06 user nova-compute[73503]:     <os_type>hvm</os_type>
Aug 26 13:07:06 user nova-compute[73503]:     <arch name='xtensaeb'>
Aug 26 13:07:06 user nova-compute[73503]:       <wordsize>32</wordsize>
Aug 26 13:07:06 user nova-compute[73503]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='4'>sim</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>kc705</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ml605</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>virt</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx200</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>lx60</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 13:07:06 user nova-compute[73503]:       <domain type='qemu'/>
Aug 26 13:07:06 user nova-compute[73503]:     </arch>
Aug 26 13:07:06 user nova-compute[73503]:     <features>
Aug 26 13:07:06 user nova-compute[73503]:       <cpuselection/>
Aug 26 13:07:06 user nova-compute[73503]:       <deviceboot/>
Aug 26 13:07:06 user nova-compute[73503]:       <disksnapshot default='on' toggle='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     </features>
Aug 26 13:07:06 user nova-compute[73503]:   </guest>
Aug 26 13:07:06 user nova-compute[73503]: </capabilities>
Aug 26 13:07:06 user nova-compute[73503]: 
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-i440fx-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>i686</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='255'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'/>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='lm'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ide</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-q35-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>i686</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='288'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'/>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='lm'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-q35-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>i686</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='288'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'/>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='lm'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-i440fx-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>i686</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='255'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'/>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='lm'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ide</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-i440fx-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>x86_64</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='255'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>efi</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='invtsc'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='rsba'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ide</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-q35-6.2</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>x86_64</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='288'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>efi</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='invtsc'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='rsba'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-q35-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>x86_64</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='288'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>efi</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='invtsc'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='rsba'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 13:07:06 user nova-compute[73503]: <domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 13:07:06 user nova-compute[73503]:   <domain>kvm</domain>
Aug 26 13:07:06 user nova-compute[73503]:   <machine>pc-i440fx-jammy</machine>
Aug 26 13:07:06 user nova-compute[73503]:   <arch>x86_64</arch>
Aug 26 13:07:06 user nova-compute[73503]:   <vcpu max='255'/>
Aug 26 13:07:06 user nova-compute[73503]:   <iothreads supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:   <os supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='firmware'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>efi</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:     <loader supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>rom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pflash</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='readonly'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>yes</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='secure'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>no</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </loader>
Aug 26 13:07:06 user nova-compute[73503]:   </os>
Aug 26 13:07:06 user nova-compute[73503]:   <cpu>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-passthrough' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='hostPassthroughMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='maximum' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='maximumMigratable'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>on</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>off</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='host-model' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <vendor>Intel</vendor>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ss'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='vmx'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pcid'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='hypervisor'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arat'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='umip'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='md-clear'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='invtsc'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibpb'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='ibrs'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-stibp'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='rsba'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='erms'/>
Aug 26 13:07:06 user nova-compute[73503]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:     <mode name='custom' supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>qemu64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>qemu32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>phenom</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>pentium</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>n270</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm64</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>kvm32</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>coreduo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>core2duo</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>athlon</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Westmere</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Snowridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Skylake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>SandyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Penryn</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G5</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G4</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G3</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Opteron_G2</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Opteron_G1</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>IvyBridge</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Icelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Haswell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Rome</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-Milan</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>EPYC</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Dhyana</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cooperlake</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>Conroe</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='no'>Broadwell</model>
Aug 26 13:07:06 user nova-compute[73503]:       <model usable='yes'>486</model>
Aug 26 13:07:06 user nova-compute[73503]:     </mode>
Aug 26 13:07:06 user nova-compute[73503]:   </cpu>
Aug 26 13:07:06 user nova-compute[73503]:   <memoryBacking supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:     <enum name='sourceType'>
Aug 26 13:07:06 user nova-compute[73503]:       <value>file</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>anonymous</value>
Aug 26 13:07:06 user nova-compute[73503]:       <value>memfd</value>
Aug 26 13:07:06 user nova-compute[73503]:     </enum>
Aug 26 13:07:06 user nova-compute[73503]:   </memoryBacking>
Aug 26 13:07:06 user nova-compute[73503]:   <devices>
Aug 26 13:07:06 user nova-compute[73503]:     <disk supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='diskDevice'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>disk</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cdrom</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>floppy</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>lun</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='bus'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ide</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>fdc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sata</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </disk>
Aug 26 13:07:06 user nova-compute[73503]:     <graphics supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='type'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>sdl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vnc</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>spice</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egl-headless</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </graphics>
Aug 26 13:07:06 user nova-compute[73503]:     <video supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='modelType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>cirrus</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>vmvga</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>qxl</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>none</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>bochs</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>ramfb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </video>
Aug 26 13:07:06 user nova-compute[73503]:     <hostdev supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='mode'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>subsystem</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='startupPolicy'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>default</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>mandatory</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>requisite</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>optional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='subsysType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>usb</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>pci</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>scsi</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='capsType'/>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='pciBackend'/>
Aug 26 13:07:06 user nova-compute[73503]:     </hostdev>
Aug 26 13:07:06 user nova-compute[73503]:     <rng supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtio-non-transitional</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>random</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>egd</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>builtin</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </rng>
Aug 26 13:07:06 user nova-compute[73503]:     <filesystem supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='driverType'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>path</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>handle</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>virtiofs</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </filesystem>
Aug 26 13:07:06 user nova-compute[73503]:     <tpm supported='yes'>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='model'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-tis</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>tpm-crb</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:       <enum name='backendModel'>
Aug 26 13:07:06 user nova-compute[73503]:         <value>passthrough</value>
Aug 26 13:07:06 user nova-compute[73503]:         <value>emulator</value>
Aug 26 13:07:06 user nova-compute[73503]:       </enum>
Aug 26 13:07:06 user nova-compute[73503]:     </tpm>
Aug 26 13:07:06 user nova-compute[73503]:   </devices>
Aug 26 13:07:06 user nova-compute[73503]:   <features>
Aug 26 13:07:06 user nova-compute[73503]:     <gic supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:     <vmcoreinfo supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <genid supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backingStoreInput supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <backup supported='yes'/>
Aug 26 13:07:06 user nova-compute[73503]:     <sev supported='no'/>
Aug 26 13:07:06 user nova-compute[73503]:   </features>
Aug 26 13:07:06 user nova-compute[73503]: </domainCapabilities>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73503) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73503) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Checking secure boot support for host arch (x86_64) {{(pid=73503) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Checking secure boot support for host arch (x86_64) {{(pid=73503) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Checking secure boot support for host arch (x86_64) {{(pid=73503) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 13:07:06 user nova-compute[73503]: INFO nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Secure Boot support detected
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] cpu compare xml: <cpu match="exact">
Aug 26 13:07:06 user nova-compute[73503]:   <model>Nehalem</model>
Aug 26 13:07:06 user nova-compute[73503]: </cpu>
Aug 26 13:07:06 user nova-compute[73503]:  {{(pid=73503) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 13:07:06 user nova-compute[73503]: INFO nova.virt.node [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Generated node identity 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2
Aug 26 13:07:06 user nova-compute[73503]: INFO nova.virt.node [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Wrote node identity 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 to /opt/stack/data/nova/compute_id
Aug 26 13:07:06 user nova-compute[73503]: WARNING nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Compute nodes ['8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 13:07:06 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 13:07:06 user nova-compute[73503]: WARNING nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 13:07:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:07:06 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:07:06 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Hypervisor/Node resource view: name=user free_ram=10840MB free_disk=26.081680297851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:07:06 user nova-compute[73503]: WARNING nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] No compute node record for user:8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 could not be found.
Aug 26 13:07:06 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Compute node record created for user:user with uuid: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:07:06 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:07:07 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [req-4ba221b7-f3b8-4506-96de-e884296b8fd1] Created resource provider record via placement API for resource provider with UUID 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 and name user.
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73503) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 13:07:07 user nova-compute[73503]: INFO nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] kernel doesn't support AMD SEV
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Libvirt baseline CPU <cpu>
Aug 26 13:07:07 user nova-compute[73503]:   <arch>x86_64</arch>
Aug 26 13:07:07 user nova-compute[73503]:   <model>Nehalem</model>
Aug 26 13:07:07 user nova-compute[73503]:   <vendor>Intel</vendor>
Aug 26 13:07:07 user nova-compute[73503]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 13:07:07 user nova-compute[73503]: </cpu>
Aug 26 13:07:07 user nova-compute[73503]:  {{(pid=73503) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Updated inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Updating resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 generation from 0 to 1 during operation: update_inventory {{(pid=73503) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Updating resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 generation from 1 to 2 during operation: update_traits {{(pid=73503) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.service [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Creating RPC server for service compute {{(pid=73503) start /opt/stack/nova/nova/service.py:182}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.service [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Join ServiceGroup membership for this service compute {{(pid=73503) start /opt/stack/nova/nova/service.py:199}}
Aug 26 13:07:07 user nova-compute[73503]: DEBUG nova.servicegroup.drivers.db [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73503) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 13:07:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_power_states {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:07:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:07:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:07:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:07:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=10275MB free_disk=25.985443115234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:07:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:08:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:08:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.03209686279297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:08:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:08:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:09:59 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:10:00 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:10:00 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:10:00 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=10208MB free_disk=25.81570816040039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:10:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.103s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:10:02 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:10:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:10:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:10:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:10:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:10:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:10:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:00 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:00 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:11:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:11:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:01 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:02 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:02 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=9378MB free_disk=25.838092803955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c3f369bd-c8ef-4b28-9866-3eb1a354f87e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.160s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:02 user nova-compute[73503]: INFO nova.compute.claims [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Claim successful on node user
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.177s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:03 user nova-compute[73503]: INFO nova.compute.claims [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Claim successful on node user
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Creating image(s)
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.policy [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd5b0cb95ba4c6984a9fe5085c87207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b5b1338f040709bafbe65939ac8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Creating image(s)
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "/opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "/opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG nova.policy [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eab46c8dd75e4d66844a6e31aac8068c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf9a969b5e3440d1a243afc140fd3266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:04 user nova-compute[73503]: INFO nova.compute.claims [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Claim successful on node user
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.part --force-share --output=json" returned: 0 in 0.248s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG nova.virt.images [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] 7020aec7-4750-4619-aaeb-1eb3136ee3e8 was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.part /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.part /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.converted" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.581s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:05 user nova-compute[73503]: INFO oslo.privsep.daemon [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp870ddmpx/privsep.sock']
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.258s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:05 user sudo[82733]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp870ddmpx/privsep.sock
Aug 26 13:11:05 user sudo[82733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:05 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:05 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Creating image(s)
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.policy [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd5b0cb95ba4c6984a9fe5085c87207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b5b1338f040709bafbe65939ac8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Successfully created port: d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:05 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Successfully created port: 037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:07 user sudo[82733]: pam_unix(sudo:session): session closed for user root
Aug 26 13:11:07 user nova-compute[73503]: INFO oslo.privsep.daemon [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Spawned new privsep daemon via rootwrap
Aug 26 13:11:07 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 13:11:07 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 13:11:07 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 13:11:07 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82736
Aug 26 13:11:07 user nova-compute[73503]: WARNING oslo_privsep.priv_context [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] privsep daemon already running
Aug 26 13:11:07 user nova-compute[73503]: WARNING oslo_privsep.priv_context [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] privsep daemon already running
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Successfully created port: 8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.228s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:07 user nova-compute[73503]: INFO nova.compute.claims [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Claim successful on node user
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk 1073741824" returned: 0 in 0.048s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.230s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk 1073741824" returned: 0 in 0.050s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.531s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Cannot resize image /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Ensure instance console log exists: /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk 1073741824" returned: 0 in 0.046s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Cannot resize image /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Ensure instance console log exists: /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Creating image(s)
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "/opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "/opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "/opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Successfully updated port: 037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Cannot resize image /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Ensure instance console log exists: /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquired lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Successfully updated port: d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.policy [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e23ee63bc296443fbe8224f94cff507a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef3f76b494bbaabf6511c70fc312c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.220s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk 1073741824" returned: 0 in 0.062s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-changed-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Refreshing instance network info cache due to event network-changed-037e80d2-252a-41a1-a9c3-73f0e0449072. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] Acquiring lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Cannot resize image /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Ensure instance console log exists: /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updating instance_info_cache with network_info: [{"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Successfully updated port: 8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Releasing lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Instance network_info: |[{"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] Acquired lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Refreshing network info cache for port 037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Start _get_guest_xml network_info=[{"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance network_info: |[{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Start _get_guest_xml network_info=[{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:10 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:10 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:10 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:10 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1741486291',display_name='tempest-DeleteServersTestJSON-server-1741486291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1741486291',id=2,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf9a969b5e3440d1a243afc140fd3266',ramdisk_id='',reservation_id='r-racl3awd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1708229277',owner_user_name='tempest-DeleteServersTestJSON-1708229277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:04Z,user_data=None,user_id='eab46c8dd75e4d66844a6e31aac8068c',uuid=c3f369bd-c8ef-4b28-9866-3eb1a354f87e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Converting VIF {"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lazy-loading 'pci_devices' on Instance uuid c3f369bd-c8ef-4b28-9866-3eb1a354f87e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1745673538',display_name='tempest-ServerRescueNegativeTestJSON-server-1745673538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1745673538',id=1,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-h9pms00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:03Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=9a0a305a-0375-41a9-9b51-a78d65270f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:10 user nova-compute[73503]:   <uuid>c3f369bd-c8ef-4b28-9866-3eb1a354f87e</uuid>
Aug 26 13:11:10 user nova-compute[73503]:   <name>instance-00000002</name>
Aug 26 13:11:10 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:10 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:10 user nova-compute[73503]:   <metadata>
Aug 26 13:11:10 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:10 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:name>tempest-DeleteServersTestJSON-server-1741486291</nova:name>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:10</nova:creationTime>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:10 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:10 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:user uuid="eab46c8dd75e4d66844a6e31aac8068c">tempest-DeleteServersTestJSON-1708229277-project-member</nova:user>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:project uuid="cf9a969b5e3440d1a243afc140fd3266">tempest-DeleteServersTestJSON-1708229277</nova:project>
Aug 26 13:11:10 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:port uuid="037e80d2-252a-41a1-a9c3-73f0e0449072">
Aug 26 13:11:10 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 13:11:10 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:10 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:10 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:10 user nova-compute[73503]:   </metadata>
Aug 26 13:11:10 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:10 user nova-compute[73503]:     <system>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="serial">c3f369bd-c8ef-4b28-9866-3eb1a354f87e</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="uuid">c3f369bd-c8ef-4b28-9866-3eb1a354f87e</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:10 user nova-compute[73503]:     </system>
Aug 26 13:11:10 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:10 user nova-compute[73503]:   <os>
Aug 26 13:11:10 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:10 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:10 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:10 user nova-compute[73503]:   </os>
Aug 26 13:11:10 user nova-compute[73503]:   <features>
Aug 26 13:11:10 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:10 user nova-compute[73503]:     <apic/>
Aug 26 13:11:10 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:10 user nova-compute[73503]:   </features>
Aug 26 13:11:10 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:10 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:10 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:10 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:10 user nova-compute[73503]:   </clock>
Aug 26 13:11:10 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:10 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:10 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:10 user nova-compute[73503]:   </cpu>
Aug 26 13:11:10 user nova-compute[73503]:   <devices>
Aug 26 13:11:10 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:10 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:10 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk"/>
Aug 26 13:11:10 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:10 user nova-compute[73503]:     </disk>
Aug 26 13:11:10 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:10 user nova-compute[73503]:       <mac address="fa:16:3e:62:4a:15"/>
Aug 26 13:11:10 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:10 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:10 user nova-compute[73503]:       <target dev="tap037e80d2-25"/>
Aug 26 13:11:10 user nova-compute[73503]:     </interface>
Aug 26 13:11:10 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:10 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/console.log" append="off"/>
Aug 26 13:11:10 user nova-compute[73503]:     </serial>
Aug 26 13:11:10 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:10 user nova-compute[73503]:     <video>
Aug 26 13:11:10 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:10 user nova-compute[73503]:     </video>
Aug 26 13:11:10 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:10 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:10 user nova-compute[73503]:     </rng>
Aug 26 13:11:10 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:10 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:10 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:10 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:10 user nova-compute[73503]:   </devices>
Aug 26 13:11:10 user nova-compute[73503]: </domain>
Aug 26 13:11:10 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1741486291',display_name='tempest-DeleteServersTestJSON-server-1741486291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1741486291',id=2,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf9a969b5e3440d1a243afc140fd3266',ramdisk_id='',reservation_id='r-racl3awd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1708229277',owner_user_name='tempest-DeleteServersTestJSON-1708229277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:04Z,user_data=None,user_id='eab46c8dd75e4d66844a6e31aac8068c',uuid=c3f369bd-c8ef-4b28-9866-3eb1a354f87e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Converting VIF {"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG os_vif [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:10 user nova-compute[73503]:   <uuid>9a0a305a-0375-41a9-9b51-a78d65270f43</uuid>
Aug 26 13:11:10 user nova-compute[73503]:   <name>instance-00000001</name>
Aug 26 13:11:10 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:10 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:10 user nova-compute[73503]:   <metadata>
Aug 26 13:11:10 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:10 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1745673538</nova:name>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:10</nova:creationTime>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:10 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:10 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:user uuid="9cd5b0cb95ba4c6984a9fe5085c87207">tempest-ServerRescueNegativeTestJSON-993610223-project-member</nova:user>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:project uuid="a84b5b1338f040709bafbe65939ac8e7">tempest-ServerRescueNegativeTestJSON-993610223</nova:project>
Aug 26 13:11:10 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:10 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:10 user nova-compute[73503]:         <nova:port uuid="d4622b1e-a61d-4f3f-9d72-cec555ea6131">
Aug 26 13:11:10 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 13:11:10 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:10 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:10 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:10 user nova-compute[73503]:   </metadata>
Aug 26 13:11:10 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:10 user nova-compute[73503]:     <system>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="serial">9a0a305a-0375-41a9-9b51-a78d65270f43</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="uuid">9a0a305a-0375-41a9-9b51-a78d65270f43</entry>
Aug 26 13:11:10 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:10 user nova-compute[73503]:     </system>
Aug 26 13:11:10 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:10 user nova-compute[73503]:   <os>
Aug 26 13:11:10 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:10 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:10 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:10 user nova-compute[73503]:   </os>
Aug 26 13:11:10 user nova-compute[73503]:   <features>
Aug 26 13:11:10 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:10 user nova-compute[73503]:     <apic/>
Aug 26 13:11:10 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:10 user nova-compute[73503]:   </features>
Aug 26 13:11:10 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:10 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:10 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:10 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:10 user nova-compute[73503]:   </clock>
Aug 26 13:11:10 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:10 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:10 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:10 user nova-compute[73503]:   </cpu>
Aug 26 13:11:10 user nova-compute[73503]:   <devices>
Aug 26 13:11:10 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:10 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:10 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk"/>
Aug 26 13:11:10 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:10 user nova-compute[73503]:     </disk>
Aug 26 13:11:10 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:10 user nova-compute[73503]:       <mac address="fa:16:3e:f2:14:2b"/>
Aug 26 13:11:10 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:10 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:10 user nova-compute[73503]:       <target dev="tapd4622b1e-a6"/>
Aug 26 13:11:10 user nova-compute[73503]:     </interface>
Aug 26 13:11:10 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:10 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/console.log" append="off"/>
Aug 26 13:11:10 user nova-compute[73503]:     </serial>
Aug 26 13:11:10 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:10 user nova-compute[73503]:     <video>
Aug 26 13:11:10 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:10 user nova-compute[73503]:     </video>
Aug 26 13:11:10 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:10 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:10 user nova-compute[73503]:     </rng>
Aug 26 13:11:10 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:10 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:10 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:10 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:10 user nova-compute[73503]:   </devices>
Aug 26 13:11:10 user nova-compute[73503]: </domain>
Aug 26 13:11:10 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1745673538',display_name='tempest-ServerRescueNegativeTestJSON-server-1745673538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1745673538',id=1,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-h9pms00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:03Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=9a0a305a-0375-41a9-9b51-a78d65270f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG os_vif [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Created schema index Interface.name {{(pid=73503) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Created schema index Port.name {{(pid=73503) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Created schema index Bridge.name {{(pid=73503) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [POLLOUT] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [POLLIN] on fd 25 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] tcp:127.0.0.1:6640: entering BACKOFF {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] schema index <ovs.db.idl.IdlTable object at 0x7fd314516fe0>.name already exists {{(pid=73503) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] schema index <ovs.db.idl.IdlTable object at 0x7fd314517010>.name already exists {{(pid=73503) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] schema index <ovs.db.idl.IdlTable object at 0x7fd3144f4d90>.name already exists {{(pid=73503) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:10 user nova-compute[73503]: INFO oslo.privsep.daemon [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpewe76sv1/privsep.sock']
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:10 user sudo[82828]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpewe76sv1/privsep.sock
Aug 26 13:11:10 user sudo[82828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 13:11:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Successfully created port: b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-changed-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Refreshing instance network info cache due to event network-changed-d4622b1e-a61d-4f3f-9d72-cec555ea6131. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Refreshing network info cache for port d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance network_info: |[{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Start _get_guest_xml network_info=[{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:11 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:11 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-701153657',display_name='tempest-ServerRescueNegativeTestJSON-server-701153657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-701153657',id=3,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-1nshvrsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:05Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=abc314fb-c2e8-4060-bd6f-4c8917d4e034,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'pci_devices' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:11 user nova-compute[73503]:   <uuid>abc314fb-c2e8-4060-bd6f-4c8917d4e034</uuid>
Aug 26 13:11:11 user nova-compute[73503]:   <name>instance-00000003</name>
Aug 26 13:11:11 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:11 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:11 user nova-compute[73503]:   <metadata>
Aug 26 13:11:11 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:11 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:11 user nova-compute[73503]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-701153657</nova:name>
Aug 26 13:11:11 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:11</nova:creationTime>
Aug 26 13:11:11 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:11 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:11 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:11 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:user uuid="9cd5b0cb95ba4c6984a9fe5085c87207">tempest-ServerRescueNegativeTestJSON-993610223-project-member</nova:user>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:project uuid="a84b5b1338f040709bafbe65939ac8e7">tempest-ServerRescueNegativeTestJSON-993610223</nova:project>
Aug 26 13:11:11 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:11 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:11 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:11 user nova-compute[73503]:         <nova:port uuid="8ffad0c8-4fd7-465a-ba9e-f7362c167ce1">
Aug 26 13:11:11 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:11:11 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:11 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:11 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:11 user nova-compute[73503]:   </metadata>
Aug 26 13:11:11 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:11 user nova-compute[73503]:     <system>
Aug 26 13:11:11 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:11 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:11 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:11 user nova-compute[73503]:       <entry name="serial">abc314fb-c2e8-4060-bd6f-4c8917d4e034</entry>
Aug 26 13:11:11 user nova-compute[73503]:       <entry name="uuid">abc314fb-c2e8-4060-bd6f-4c8917d4e034</entry>
Aug 26 13:11:11 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:11 user nova-compute[73503]:     </system>
Aug 26 13:11:11 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:11 user nova-compute[73503]:   <os>
Aug 26 13:11:11 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:11 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:11 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:11 user nova-compute[73503]:   </os>
Aug 26 13:11:11 user nova-compute[73503]:   <features>
Aug 26 13:11:11 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:11 user nova-compute[73503]:     <apic/>
Aug 26 13:11:11 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:11 user nova-compute[73503]:   </features>
Aug 26 13:11:11 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:11 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:11 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:11 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:11 user nova-compute[73503]:   </clock>
Aug 26 13:11:11 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:11 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:11 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:11 user nova-compute[73503]:   </cpu>
Aug 26 13:11:11 user nova-compute[73503]:   <devices>
Aug 26 13:11:11 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:11 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:11 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk"/>
Aug 26 13:11:11 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:11 user nova-compute[73503]:     </disk>
Aug 26 13:11:11 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:11 user nova-compute[73503]:       <mac address="fa:16:3e:bc:dc:16"/>
Aug 26 13:11:11 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:11 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:11 user nova-compute[73503]:       <target dev="tap8ffad0c8-4f"/>
Aug 26 13:11:11 user nova-compute[73503]:     </interface>
Aug 26 13:11:11 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:11 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/console.log" append="off"/>
Aug 26 13:11:11 user nova-compute[73503]:     </serial>
Aug 26 13:11:11 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:11 user nova-compute[73503]:     <video>
Aug 26 13:11:11 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:11 user nova-compute[73503]:     </video>
Aug 26 13:11:11 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:11 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:11 user nova-compute[73503]:     </rng>
Aug 26 13:11:11 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:11 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:11 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:11 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:11 user nova-compute[73503]:   </devices>
Aug 26 13:11:11 user nova-compute[73503]: </domain>
Aug 26 13:11:11 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-701153657',display_name='tempest-ServerRescueNegativeTestJSON-server-701153657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-701153657',id=3,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-1nshvrsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:05Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=abc314fb-c2e8-4060-bd6f-4c8917d4e034,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG os_vif [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updated VIF entry in instance network info cache for port 037e80d2-252a-41a1-a9c3-73f0e0449072. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updating instance_info_cache with network_info: [{"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7f3278f9-4591-4e4b-bc13-c89781382946 req-46cb613a-946f-46e0-80b8-29e248fe1ce8 service nova] Releasing lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:12 user sudo[82828]: pam_unix(sudo:session): session closed for user root
Aug 26 13:11:12 user nova-compute[73503]: INFO oslo.privsep.daemon [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Spawned new privsep daemon via rootwrap
Aug 26 13:11:12 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 13:11:12 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 13:11:12 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 13:11:12 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82860
Aug 26 13:11:12 user nova-compute[73503]: WARNING oslo_privsep.priv_context [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] privsep daemon already running
Aug 26 13:11:12 user nova-compute[73503]: WARNING oslo_privsep.priv_context [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] privsep daemon already running
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updated VIF entry in instance network info cache for port d4622b1e-a61d-4f3f-9d72-cec555ea6131. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-changed-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Refreshing instance network info cache due to event network-changed-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] Acquiring lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] Acquired lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Refreshing network info cache for port 8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap037e80d2-25, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap037e80d2-25, col_values=(('external_ids', {'iface-id': '037e80d2-252a-41a1-a9c3-73f0e0449072', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:4a:15', 'vm-uuid': 'c3f369bd-c8ef-4b28-9866-3eb1a354f87e'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: INFO os_vif [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25')
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4622b1e-a6, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4622b1e-a6, col_values=(('external_ids', {'iface-id': 'd4622b1e-a61d-4f3f-9d72-cec555ea6131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:14:2b', 'vm-uuid': '9a0a305a-0375-41a9-9b51-a78d65270f43'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: INFO os_vif [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6')
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ffad0c8-4f, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ffad0c8-4f, col_values=(('external_ids', {'iface-id': '8ffad0c8-4fd7-465a-ba9e-f7362c167ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:dc:16', 'vm-uuid': 'abc314fb-c2e8-4060-bd6f-4c8917d4e034'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:13 user nova-compute[73503]: INFO os_vif [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f')
Aug 26 13:11:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] No VIF found with MAC fa:16:3e:62:4a:15, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:f2:14:2b, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:bc:dc:16, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Successfully updated port: b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquired lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-changed-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Refreshing instance network info cache due to event network-changed-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] Acquiring lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.network.neutron [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updated VIF entry in instance network info cache for port 8ffad0c8-4fd7-465a-ba9e-f7362c167ce1. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG nova.network.neutron [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14eb70ca-7c58-4edb-b1ab-14edb5d90d9b req-c759e7bb-ba13-4698-a187-279505437f16 service nova] Releasing lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updating instance_info_cache with network_info: [{"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Releasing lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Instance network_info: |[{"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] Acquired lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.network.neutron [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Refreshing network info cache for port b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Start _get_guest_xml network_info=[{"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:15 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:15 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-258058592',display_name='tempest-ServersNegativeTestJSON-server-258058592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-258058592',id=4,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='933ef3f76b494bbaabf6511c70fc312c',ramdisk_id='',reservation_id='r-f2cyowm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-410549196',owner_user_name='tempest-ServersNegativeTestJSON-410549196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:08Z,user_data=None,user_id='e23ee63bc296443fbe8224f94cff507a',uuid=950df9cd-10d7-45cb-9714-9ee01f508acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converting VIF {"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lazy-loading 'pci_devices' on Instance uuid 950df9cd-10d7-45cb-9714-9ee01f508acd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:15 user nova-compute[73503]:   <uuid>950df9cd-10d7-45cb-9714-9ee01f508acd</uuid>
Aug 26 13:11:15 user nova-compute[73503]:   <name>instance-00000004</name>
Aug 26 13:11:15 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:15 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:15 user nova-compute[73503]:   <metadata>
Aug 26 13:11:15 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:15 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:15 user nova-compute[73503]:       <nova:name>tempest-ServersNegativeTestJSON-server-258058592</nova:name>
Aug 26 13:11:15 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:15</nova:creationTime>
Aug 26 13:11:15 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:15 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:15 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:15 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:user uuid="e23ee63bc296443fbe8224f94cff507a">tempest-ServersNegativeTestJSON-410549196-project-member</nova:user>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:project uuid="933ef3f76b494bbaabf6511c70fc312c">tempest-ServersNegativeTestJSON-410549196</nova:project>
Aug 26 13:11:15 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:15 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:15 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:15 user nova-compute[73503]:         <nova:port uuid="b77d912b-20b6-4be1-9b84-eb14ab1b1ed3">
Aug 26 13:11:15 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 13:11:15 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:15 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:15 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:15 user nova-compute[73503]:   </metadata>
Aug 26 13:11:15 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:15 user nova-compute[73503]:     <system>
Aug 26 13:11:15 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:15 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:15 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:15 user nova-compute[73503]:       <entry name="serial">950df9cd-10d7-45cb-9714-9ee01f508acd</entry>
Aug 26 13:11:15 user nova-compute[73503]:       <entry name="uuid">950df9cd-10d7-45cb-9714-9ee01f508acd</entry>
Aug 26 13:11:15 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:15 user nova-compute[73503]:     </system>
Aug 26 13:11:15 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:15 user nova-compute[73503]:   <os>
Aug 26 13:11:15 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:15 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:15 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:15 user nova-compute[73503]:   </os>
Aug 26 13:11:15 user nova-compute[73503]:   <features>
Aug 26 13:11:15 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:15 user nova-compute[73503]:     <apic/>
Aug 26 13:11:15 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:15 user nova-compute[73503]:   </features>
Aug 26 13:11:15 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:15 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:15 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:15 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:15 user nova-compute[73503]:   </clock>
Aug 26 13:11:15 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:15 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:15 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:15 user nova-compute[73503]:   </cpu>
Aug 26 13:11:15 user nova-compute[73503]:   <devices>
Aug 26 13:11:15 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:15 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:15 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk"/>
Aug 26 13:11:15 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:15 user nova-compute[73503]:     </disk>
Aug 26 13:11:15 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:15 user nova-compute[73503]:       <mac address="fa:16:3e:7f:8d:84"/>
Aug 26 13:11:15 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:15 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:15 user nova-compute[73503]:       <target dev="tapb77d912b-20"/>
Aug 26 13:11:15 user nova-compute[73503]:     </interface>
Aug 26 13:11:15 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:15 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/console.log" append="off"/>
Aug 26 13:11:15 user nova-compute[73503]:     </serial>
Aug 26 13:11:15 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:15 user nova-compute[73503]:     <video>
Aug 26 13:11:15 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:15 user nova-compute[73503]:     </video>
Aug 26 13:11:15 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:15 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:15 user nova-compute[73503]:     </rng>
Aug 26 13:11:15 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:15 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:15 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:15 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:15 user nova-compute[73503]:   </devices>
Aug 26 13:11:15 user nova-compute[73503]: </domain>
Aug 26 13:11:15 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-258058592',display_name='tempest-ServersNegativeTestJSON-server-258058592',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-258058592',id=4,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='933ef3f76b494bbaabf6511c70fc312c',ramdisk_id='',reservation_id='r-f2cyowm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-410549196',owner_user_name='tempest-ServersNegativeTestJSON-410549196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:08Z,user_data=None,user_id='e23ee63bc296443fbe8224f94cff507a',uuid=950df9cd-10d7-45cb-9714-9ee01f508acd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converting VIF {"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG os_vif [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb77d912b-20, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb77d912b-20, col_values=(('external_ids', {'iface-id': 'b77d912b-20b6-4be1-9b84-eb14ab1b1ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:8d:84', 'vm-uuid': '950df9cd-10d7-45cb-9714-9ee01f508acd'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:15 user nova-compute[73503]: INFO os_vif [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20')
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] No VIF found with MAC fa:16:3e:7f:8d:84, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updated VIF entry in instance network info cache for port b77d912b-20b6-4be1-9b84-eb14ab1b1ed3. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updating instance_info_cache with network_info: [{"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-156d482d-e5cd-48b7-90e4-5ee511501e5a req-3a8b9d9b-1b86-4ad4-acfb-ad262eaab620 service nova] Releasing lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:18 user nova-compute[73503]: INFO nova.compute.claims [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Claim successful on node user
Aug 26 13:11:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:18 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.policy [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9c0aa45010e48a0ba0082cfff7b2cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f45bb3c25384abfba41a5146a55a7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:18 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Creating image(s)
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:19 user nova-compute[73503]: INFO nova.compute.claims [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Claim successful on node user
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.225s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.244s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk 1073741824" returned: 0 in 0.054s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:19 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.policy [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a9851519cfc49c388894f0884261586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8967f8280045e8b45d9298bda30914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:19 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Creating image(s)
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "/opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "/opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Cannot resize image /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Ensure instance console log exists: /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Successfully created port: 70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk 1073741824" returned: 0 in 0.074s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.229s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055480.6706977, abc314fb-c2e8-4060-bd6f-4c8917d4e034 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] VM Resumed (Lifecycle Event)
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance spawned successfully.
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Cannot resize image /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Ensure instance console log exists: /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055480.672112, abc314fb-c2e8-4060-bd6f-4c8917d4e034 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] VM Started (Lifecycle Event)
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Took 15.45 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:20 user nova-compute[73503]: INFO nova.compute.manager [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Took 16.46 seconds to build instance.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7557b29-f657-4602-a38e-890b3bc4cf25 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.074s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Successfully created port: 8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055481.5006173, c3f369bd-c8ef-4b28-9866-3eb1a354f87e => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] VM Resumed (Lifecycle Event)
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Instance spawned successfully.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055481.5016468, c3f369bd-c8ef-4b28-9866-3eb1a354f87e => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] VM Started (Lifecycle Event)
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance spawned successfully.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Took 17.78 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055481.6154888, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Resumed (Lifecycle Event)
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Took 18.19 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055481.6156418, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Started (Lifecycle Event)
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Successfully updated port: 70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:21 user nova-compute[73503]: INFO nova.compute.manager [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Took 18.97 seconds to build instance.
Aug 26 13:11:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-changed-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Refreshing instance network info cache due to event network-changed-70726c37-f682-40cd-9155-843aca57acf4. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1f5fe5d5-14b9-4bfb-84d9-4ba25ef57ddd tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.255s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Instance spawned successfully.
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Took 19.55 seconds to build instance.
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055481.884279, 950df9cd-10d7-45cb-9714-9ee01f508acd => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] VM Resumed (Lifecycle Event)
Aug 26 13:11:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0280fc55-3411-42aa-af9d-76d7a481f27d tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.856s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055481.8848019, 950df9cd-10d7-45cb-9714-9ee01f508acd => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] VM Started (Lifecycle Event)
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Took 13.75 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:22 user nova-compute[73503]: INFO nova.compute.manager [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Took 14.92 seconds to build instance.
Aug 26 13:11:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9197baa2-9a66-4a9c-a3f5-a5de4fe42c4e tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.084s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance network_info: |[{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.neutron [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Refreshing network info cache for port 70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start _get_guest_xml network_info=[{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:23 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:23 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'pci_devices' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:23 user nova-compute[73503]:   <uuid>11b30921-6ad1-4c04-8b5b-a98220732787</uuid>
Aug 26 13:11:23 user nova-compute[73503]:   <name>instance-00000005</name>
Aug 26 13:11:23 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:23 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:23 user nova-compute[73503]:   <metadata>
Aug 26 13:11:23 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:23 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:23 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherB-server-1082919212</nova:name>
Aug 26 13:11:23 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:23</nova:creationTime>
Aug 26 13:11:23 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:23 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:23 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:23 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:user uuid="f9c0aa45010e48a0ba0082cfff7b2cc5">tempest-ServerActionsTestOtherB-100333381-project-member</nova:user>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:project uuid="0f45bb3c25384abfba41a5146a55a7e7">tempest-ServerActionsTestOtherB-100333381</nova:project>
Aug 26 13:11:23 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:23 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:23 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:23 user nova-compute[73503]:         <nova:port uuid="70726c37-f682-40cd-9155-843aca57acf4">
Aug 26 13:11:23 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:11:23 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:23 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:23 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:23 user nova-compute[73503]:   </metadata>
Aug 26 13:11:23 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:23 user nova-compute[73503]:     <system>
Aug 26 13:11:23 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:23 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:23 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:23 user nova-compute[73503]:       <entry name="serial">11b30921-6ad1-4c04-8b5b-a98220732787</entry>
Aug 26 13:11:23 user nova-compute[73503]:       <entry name="uuid">11b30921-6ad1-4c04-8b5b-a98220732787</entry>
Aug 26 13:11:23 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:23 user nova-compute[73503]:     </system>
Aug 26 13:11:23 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:23 user nova-compute[73503]:   <os>
Aug 26 13:11:23 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:23 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:23 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:23 user nova-compute[73503]:   </os>
Aug 26 13:11:23 user nova-compute[73503]:   <features>
Aug 26 13:11:23 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:23 user nova-compute[73503]:     <apic/>
Aug 26 13:11:23 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:23 user nova-compute[73503]:   </features>
Aug 26 13:11:23 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:23 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:23 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:23 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:23 user nova-compute[73503]:   </clock>
Aug 26 13:11:23 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:23 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:23 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:23 user nova-compute[73503]:   </cpu>
Aug 26 13:11:23 user nova-compute[73503]:   <devices>
Aug 26 13:11:23 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:23 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:23 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk"/>
Aug 26 13:11:23 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:23 user nova-compute[73503]:     </disk>
Aug 26 13:11:23 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:23 user nova-compute[73503]:       <mac address="fa:16:3e:c5:4c:46"/>
Aug 26 13:11:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:23 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:23 user nova-compute[73503]:       <target dev="tap70726c37-f6"/>
Aug 26 13:11:23 user nova-compute[73503]:     </interface>
Aug 26 13:11:23 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:23 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/console.log" append="off"/>
Aug 26 13:11:23 user nova-compute[73503]:     </serial>
Aug 26 13:11:23 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:23 user nova-compute[73503]:     <video>
Aug 26 13:11:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:23 user nova-compute[73503]:     </video>
Aug 26 13:11:23 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:23 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:23 user nova-compute[73503]:     </rng>
Aug 26 13:11:23 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:23 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:23 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:23 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:23 user nova-compute[73503]:   </devices>
Aug 26 13:11:23 user nova-compute[73503]: </domain>
Aug 26 13:11:23 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG os_vif [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70726c37-f6, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70726c37-f6, col_values=(('external_ids', {'iface-id': '70726c37-f682-40cd-9155-843aca57acf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:4c:46', 'vm-uuid': '11b30921-6ad1-4c04-8b5b-a98220732787'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:23 user nova-compute[73503]: INFO os_vif [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6')
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No VIF found with MAC fa:16:3e:c5:4c:46, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Successfully updated port: 8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:24 user nova-compute[73503]: WARNING nova.compute.manager [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state active and task_state None.
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-changed-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Refreshing instance network info cache due to event network-changed-8b2435b5-a0f6-40b5-819e-7fb2630cb39e. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.network.neutron [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updated VIF entry in instance network info cache for port 70726c37-f682-40cd-9155-843aca57acf4. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.network.neutron [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1316ba95-f892-490b-bfe4-4218172c9bf9 req-5b71d807-1535-493e-955d-3471d4c89161 service nova] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Instance network_info: |[{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.network.neutron [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Refreshing network info cache for port 8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Start _get_guest_xml network_info=[{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-821694891',display_name='tempest-ServerActionsTestOtherA-server-821694891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-821694891',id=6,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-lu26dbrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=7bf15cad-4bbf-4d7f-b811-7cf79758e1af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bf15cad-4bbf-4d7f-b811-7cf79758e1af {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:25 user nova-compute[73503]:   <uuid>7bf15cad-4bbf-4d7f-b811-7cf79758e1af</uuid>
Aug 26 13:11:25 user nova-compute[73503]:   <name>instance-00000006</name>
Aug 26 13:11:25 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:25 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:25 user nova-compute[73503]:   <metadata>
Aug 26 13:11:25 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:25 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:25 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherA-server-821694891</nova:name>
Aug 26 13:11:25 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:24</nova:creationTime>
Aug 26 13:11:25 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:25 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:25 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:25 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:user uuid="2a9851519cfc49c388894f0884261586">tempest-ServerActionsTestOtherA-856596274-project-member</nova:user>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:project uuid="9f8967f8280045e8b45d9298bda30914">tempest-ServerActionsTestOtherA-856596274</nova:project>
Aug 26 13:11:25 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:25 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:25 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:25 user nova-compute[73503]:         <nova:port uuid="8b2435b5-a0f6-40b5-819e-7fb2630cb39e">
Aug 26 13:11:25 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:11:25 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:25 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:25 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:25 user nova-compute[73503]:   </metadata>
Aug 26 13:11:25 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:25 user nova-compute[73503]:     <system>
Aug 26 13:11:25 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:25 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:25 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:25 user nova-compute[73503]:       <entry name="serial">7bf15cad-4bbf-4d7f-b811-7cf79758e1af</entry>
Aug 26 13:11:25 user nova-compute[73503]:       <entry name="uuid">7bf15cad-4bbf-4d7f-b811-7cf79758e1af</entry>
Aug 26 13:11:25 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:25 user nova-compute[73503]:     </system>
Aug 26 13:11:25 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:25 user nova-compute[73503]:   <os>
Aug 26 13:11:25 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:25 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:25 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:25 user nova-compute[73503]:   </os>
Aug 26 13:11:25 user nova-compute[73503]:   <features>
Aug 26 13:11:25 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:25 user nova-compute[73503]:     <apic/>
Aug 26 13:11:25 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:25 user nova-compute[73503]:   </features>
Aug 26 13:11:25 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:25 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:25 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:25 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:25 user nova-compute[73503]:   </clock>
Aug 26 13:11:25 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:25 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:25 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:25 user nova-compute[73503]:   </cpu>
Aug 26 13:11:25 user nova-compute[73503]:   <devices>
Aug 26 13:11:25 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:25 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:25 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk"/>
Aug 26 13:11:25 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:25 user nova-compute[73503]:     </disk>
Aug 26 13:11:25 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:25 user nova-compute[73503]:       <mac address="fa:16:3e:5e:76:0f"/>
Aug 26 13:11:25 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:25 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:25 user nova-compute[73503]:       <target dev="tap8b2435b5-a0"/>
Aug 26 13:11:25 user nova-compute[73503]:     </interface>
Aug 26 13:11:25 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:25 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/console.log" append="off"/>
Aug 26 13:11:25 user nova-compute[73503]:     </serial>
Aug 26 13:11:25 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:25 user nova-compute[73503]:     <video>
Aug 26 13:11:25 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:25 user nova-compute[73503]:     </video>
Aug 26 13:11:25 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:25 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:25 user nova-compute[73503]:     </rng>
Aug 26 13:11:25 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:25 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:25 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:25 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:25 user nova-compute[73503]:   </devices>
Aug 26 13:11:25 user nova-compute[73503]: </domain>
Aug 26 13:11:25 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-821694891',display_name='tempest-ServerActionsTestOtherA-server-821694891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-821694891',id=6,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-lu26dbrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=7bf15cad-4bbf-4d7f-b811-7cf79758e1af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG os_vif [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b2435b5-a0, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b2435b5-a0, col_values=(('external_ids', {'iface-id': '8b2435b5-a0f6-40b5-819e-7fb2630cb39e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:76:0f', 'vm-uuid': '7bf15cad-4bbf-4d7f-b811-7cf79758e1af'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: INFO os_vif [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0')
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No VIF found with MAC fa:16:3e:5e:76:0f, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updated VIF entry in instance network info cache for port 8b2435b5-a0f6-40b5-819e-7fb2630cb39e. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64df21ac-bd52-44e1-9e8f-03e5eaac5e7c req-c841e6eb-6e7a-49b8-b16a-863f3352c6a6 service nova] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:26 user nova-compute[73503]: WARNING nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state active and task_state None.
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] No waiting events found dispatching network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:26 user nova-compute[73503]: WARNING nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received unexpected event network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 for instance with vm_state active and task_state None.
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] No waiting events found dispatching network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:26 user nova-compute[73503]: WARNING nova.compute.manager [req-c1deec47-163d-4445-a430-bcf3f6c3dfb5 req-6aa9cc9f-878c-4509-8e63-2eaf3811fee4 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received unexpected event network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 for instance with vm_state active and task_state None.
Aug 26 13:11:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:29 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055489.994028, 11b30921-6ad1-4c04-8b5b-a98220732787 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Resumed (Lifecycle Event)
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance spawned successfully.
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055490.0104575, 11b30921-6ad1-4c04-8b5b-a98220732787 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Started (Lifecycle Event)
Aug 26 13:11:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Took 11.31 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Took 12.31 seconds to build instance.
Aug 26 13:11:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-28816bc7-d66c-4302-a587-07dc720ac228 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.505s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055490.7075498, 7bf15cad-4bbf-4d7f-b811-7cf79758e1af => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] VM Resumed (Lifecycle Event)
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Instance spawned successfully.
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055490.723554, 7bf15cad-4bbf-4d7f-b811-7cf79758e1af => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] VM Started (Lifecycle Event)
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:31 user nova-compute[73503]: INFO nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Took 11.29 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:31 user nova-compute[73503]: INFO nova.compute.manager [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Took 12.58 seconds to build instance.
Aug 26 13:11:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ccacec5b-1118-4d27-a221-e9639193cb9e tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.748s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:39 user nova-compute[73503]: INFO nova.compute.claims [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Claim successful on node user
Aug 26 13:11:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:40 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:40 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.554s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Creating image(s)
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "/opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "/opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "/opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG nova.policy [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e355237acb74d80b008f41672cea5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46148f4972634a4fbd1987020a7a5d85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.260s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.284s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk 1073741824" returned: 0 in 0.063s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.238s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Cannot resize image /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Ensure instance console log exists: /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Successfully created port: adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-f45135d1-bdfa-49ad-b3a8-9102a4b5c511 req-f2ee2c8a-688e-41c9-b016-fe2d97d3ee9e service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f45135d1-bdfa-49ad-b3a8-9102a4b5c511 req-f2ee2c8a-688e-41c9-b016-fe2d97d3ee9e service nova] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f45135d1-bdfa-49ad-b3a8-9102a4b5c511 req-f2ee2c8a-688e-41c9-b016-fe2d97d3ee9e service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f45135d1-bdfa-49ad-b3a8-9102a4b5c511 req-f2ee2c8a-688e-41c9-b016-fe2d97d3ee9e service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-f45135d1-bdfa-49ad-b3a8-9102a4b5c511 req-f2ee2c8a-688e-41c9-b016-fe2d97d3ee9e service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] No waiting events found dispatching network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:43 user nova-compute[73503]: WARNING nova.compute.manager [req-f45135d1-bdfa-49ad-b3a8-9102a4b5c511 req-f2ee2c8a-688e-41c9-b016-fe2d97d3ee9e service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received unexpected event network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 for instance with vm_state active and task_state None.
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:43 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:43 user nova-compute[73503]: INFO nova.compute.claims [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Claim successful on node user
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Successfully updated port: adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquired lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-changed-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Refreshing instance network info cache due to event network-changed-adb80339-d391-4325-a8f9-f08a6a202667. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] Acquiring lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Creating image(s)
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "/opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "/opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "8edf0ee00a3e77946fb94eaaae3a39231e780c65" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "8edf0ee00a3e77946fb94eaaae3a39231e780c65" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.policy [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c34564d65f640599b8b5c39b2640c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1808f8a1626f4371a3478142569aab21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.part --force-share --output=json" returned: 0 in 0.258s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.virt.images [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] 03e24fa2-1c9f-4014-ad25-11c1b0debd9b was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.part /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] No waiting events found dispatching network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received unexpected event network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 for instance with vm_state active and task_state None.
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state None.
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1e39ad4c-2abb-4410-926f-aef1c5dfaede req-72fa422c-ddfc-4e57-be5f-78e850299d88 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state None.
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.part /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.converted" returned: 0 in 0.213s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-f82d0fa7-61b6-4ce0-8a7c-5c1d5d811314 req-2a36ba43-067f-4411-b2e7-de5b1391d1af service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f82d0fa7-61b6-4ce0-8a7c-5c1d5d811314 req-2a36ba43-067f-4411-b2e7-de5b1391d1af service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f82d0fa7-61b6-4ce0-8a7c-5c1d5d811314 req-2a36ba43-067f-4411-b2e7-de5b1391d1af service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f82d0fa7-61b6-4ce0-8a7c-5c1d5d811314 req-2a36ba43-067f-4411-b2e7-de5b1391d1af service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-f82d0fa7-61b6-4ce0-8a7c-5c1d5d811314 req-2a36ba43-067f-4411-b2e7-de5b1391d1af service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:45 user nova-compute[73503]: WARNING nova.compute.manager [req-f82d0fa7-61b6-4ce0-8a7c-5c1d5d811314 req-2a36ba43-067f-4411-b2e7-de5b1391d1af service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state active and task_state None.
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "8edf0ee00a3e77946fb94eaaae3a39231e780c65" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.262s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updating instance_info_cache with network_info: [{"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Releasing lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Instance network_info: |[{"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] Acquired lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.network.neutron [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Refreshing network info cache for port adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Start _get_guest_xml network_info=[{"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:46 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:46 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-321211458',display_name='tempest-VolumesAdminNegativeTest-server-321211458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-321211458',id=7,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+ez0YIDNiNQoc2ie5SfikedQwmR0bMP3a85tEpo5nSQdhZAwXf7C5WRns0irk+RHp+45n5gWzZrBOnem+oNRZOwV80m8KETKblbaw/Yl1oV7H5mm8E8ZDrCXi/1KT2gQ==',key_name='tempest-keypair-315029503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46148f4972634a4fbd1987020a7a5d85',ramdisk_id='',reservation_id='r-w2tpl0zz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-762845259',owner_user_name='tempest-VolumesAdminNegativeTest-762845259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e355237acb74d80b008f41672cea5d2',uuid=0afddfbd-234e-4ff0-9f88-35c7ee05d1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converting VIF {"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'pci_devices' on Instance uuid 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 --force-share --output=json" returned: 0 in 0.341s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "8edf0ee00a3e77946fb94eaaae3a39231e780c65" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "8edf0ee00a3e77946fb94eaaae3a39231e780c65" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:46 user nova-compute[73503]:   <uuid>0afddfbd-234e-4ff0-9f88-35c7ee05d1e8</uuid>
Aug 26 13:11:46 user nova-compute[73503]:   <name>instance-00000007</name>
Aug 26 13:11:46 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:46 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:46 user nova-compute[73503]:   <metadata>
Aug 26 13:11:46 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:46 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:46 user nova-compute[73503]:       <nova:name>tempest-VolumesAdminNegativeTest-server-321211458</nova:name>
Aug 26 13:11:46 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:46</nova:creationTime>
Aug 26 13:11:46 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:46 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:46 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:46 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:user uuid="4e355237acb74d80b008f41672cea5d2">tempest-VolumesAdminNegativeTest-762845259-project-member</nova:user>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:project uuid="46148f4972634a4fbd1987020a7a5d85">tempest-VolumesAdminNegativeTest-762845259</nova:project>
Aug 26 13:11:46 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:46 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:46 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:46 user nova-compute[73503]:         <nova:port uuid="adb80339-d391-4325-a8f9-f08a6a202667">
Aug 26 13:11:46 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 13:11:46 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:46 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:46 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:46 user nova-compute[73503]:   </metadata>
Aug 26 13:11:46 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:46 user nova-compute[73503]:     <system>
Aug 26 13:11:46 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:46 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:46 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:46 user nova-compute[73503]:       <entry name="serial">0afddfbd-234e-4ff0-9f88-35c7ee05d1e8</entry>
Aug 26 13:11:46 user nova-compute[73503]:       <entry name="uuid">0afddfbd-234e-4ff0-9f88-35c7ee05d1e8</entry>
Aug 26 13:11:46 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:46 user nova-compute[73503]:     </system>
Aug 26 13:11:46 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:46 user nova-compute[73503]:   <os>
Aug 26 13:11:46 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:46 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:46 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:46 user nova-compute[73503]:   </os>
Aug 26 13:11:46 user nova-compute[73503]:   <features>
Aug 26 13:11:46 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:46 user nova-compute[73503]:     <apic/>
Aug 26 13:11:46 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:46 user nova-compute[73503]:   </features>
Aug 26 13:11:46 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:46 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:46 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:46 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:46 user nova-compute[73503]:   </clock>
Aug 26 13:11:46 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:46 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:46 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:46 user nova-compute[73503]:   </cpu>
Aug 26 13:11:46 user nova-compute[73503]:   <devices>
Aug 26 13:11:46 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:46 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:46 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk"/>
Aug 26 13:11:46 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:46 user nova-compute[73503]:     </disk>
Aug 26 13:11:46 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:46 user nova-compute[73503]:       <mac address="fa:16:3e:df:6d:0a"/>
Aug 26 13:11:46 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:46 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:46 user nova-compute[73503]:       <target dev="tapadb80339-d3"/>
Aug 26 13:11:46 user nova-compute[73503]:     </interface>
Aug 26 13:11:46 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:46 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/console.log" append="off"/>
Aug 26 13:11:46 user nova-compute[73503]:     </serial>
Aug 26 13:11:46 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:46 user nova-compute[73503]:     <video>
Aug 26 13:11:46 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:46 user nova-compute[73503]:     </video>
Aug 26 13:11:46 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:46 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:46 user nova-compute[73503]:     </rng>
Aug 26 13:11:46 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:46 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:46 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:46 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:46 user nova-compute[73503]:   </devices>
Aug 26 13:11:46 user nova-compute[73503]: </domain>
Aug 26 13:11:46 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-321211458',display_name='tempest-VolumesAdminNegativeTest-server-321211458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-321211458',id=7,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+ez0YIDNiNQoc2ie5SfikedQwmR0bMP3a85tEpo5nSQdhZAwXf7C5WRns0irk+RHp+45n5gWzZrBOnem+oNRZOwV80m8KETKblbaw/Yl1oV7H5mm8E8ZDrCXi/1KT2gQ==',key_name='tempest-keypair-315029503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46148f4972634a4fbd1987020a7a5d85',ramdisk_id='',reservation_id='r-w2tpl0zz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-762845259',owner_user_name='tempest-VolumesAdminNegativeTest-762845259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e355237acb74d80b008f41672cea5d2',uuid=0afddfbd-234e-4ff0-9f88-35c7ee05d1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converting VIF {"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG os_vif [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadb80339-d3, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadb80339-d3, col_values=(('external_ids', {'iface-id': 'adb80339-d391-4325-a8f9-f08a6a202667', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:6d:0a', 'vm-uuid': '0afddfbd-234e-4ff0-9f88-35c7ee05d1e8'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:46 user nova-compute[73503]: INFO os_vif [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3')
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No VIF found with MAC fa:16:3e:df:6d:0a, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 --force-share --output=json" returned: 0 in 0.262s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65,backing_fmt=raw /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65,backing_fmt=raw /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk 1073741824" returned: 0 in 0.150s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "8edf0ee00a3e77946fb94eaaae3a39231e780c65" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.418s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 --force-share --output=json" returned: 0 in 0.256s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Cannot resize image /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updated VIF entry in instance network info cache for port adb80339-d391-4325-a8f9-f08a6a202667. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updating instance_info_cache with network_info: [{"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6405e81a-fd6b-4181-8b01-00c650b60f7a req-d2de27e6-97f4-4260-97d4-7910435ecfc8 service nova] Releasing lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:48 user nova-compute[73503]: WARNING nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state active and task_state None.
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:48 user nova-compute[73503]: WARNING nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state active and task_state None.
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:48 user nova-compute[73503]: WARNING nova.compute.manager [req-bafc3626-d65e-423d-a670-6ffff0832c09 req-6ebe81e5-a38c-4120-a7c8-dedad7c69489 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state active and task_state None.
Aug 26 13:11:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Successfully created port: e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Successfully updated port: e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquired lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] No waiting events found dispatching network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:50 user nova-compute[73503]: WARNING nova.compute.manager [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received unexpected event network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 for instance with vm_state building and task_state spawning.
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] No waiting events found dispatching network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:50 user nova-compute[73503]: WARNING nova.compute.manager [req-520d876a-d27f-48b9-a97d-c0ce10192fd2 req-ae5908a9-8ee8-46e4-94f1-4cc07418f3ce service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received unexpected event network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 for instance with vm_state building and task_state spawning.
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-changed-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Refreshing instance network info cache due to event network-changed-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] Acquiring lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updating instance_info_cache with network_info: [{"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Releasing lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Instance network_info: |[{"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] Acquired lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Refreshing network info cache for port e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Start _get_guest_xml network_info=[{"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:11:32Z,direct_url=<?>,disk_format='qcow2',id=03e24fa2-1c9f-4014-ad25-11c1b0debd9b,min_disk=0,min_ram=0,name='',owner='af41a0e05c7d487a8c89d331c5bb5638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:11:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/sda', 'encrypted': False, 'disk_bus': 'scsi', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '03e24fa2-1c9f-4014-ad25-11c1b0debd9b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:11:32Z,direct_url=<?>,disk_format='qcow2',id=03e24fa2-1c9f-4014-ad25-11c1b0debd9b,min_disk=0,min_ram=0,name='',owner='af41a0e05c7d487a8c89d331c5bb5638',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:11:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2058072162',display_name='tempest-AttachSCSIVolumeTestJSON-server-2058072162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2058072162',id=8,image_ref='03e24fa2-1c9f-4014-ad25-11c1b0debd9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtvMaB0wRIGuPJFFUHekkQtJGQDkqUFAnFh3HP1aXvuwTfFqZf9CcPT+T8ajyzzAFXKNA9Yp1sXmvoAYuNqfJiGcEZEhNl9m3IU3euE5Sey9lguwUyNYCRIQsITrPdXrw==',key_name='tempest-keypair-1206419595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1808f8a1626f4371a3478142569aab21',ramdisk_id='',reservation_id='r-2ki0buv0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='03e24fa2-1c9f-4014-ad25-11c1b0debd9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-633590100',owner_user_name='tempest-AttachSCSIVolumeTestJSON-633590100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c34564d65f640599b8b5c39b2640c91',uuid=fdc9d288-a75f-452f-b378-c7dcb52d4e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Converting VIF {"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lazy-loading 'pci_devices' on Instance uuid fdc9d288-a75f-452f-b378-c7dcb52d4e6f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:50 user nova-compute[73503]:   <uuid>fdc9d288-a75f-452f-b378-c7dcb52d4e6f</uuid>
Aug 26 13:11:50 user nova-compute[73503]:   <name>instance-00000008</name>
Aug 26 13:11:50 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:50 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:50 user nova-compute[73503]:   <metadata>
Aug 26 13:11:50 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:50 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:50 user nova-compute[73503]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2058072162</nova:name>
Aug 26 13:11:50 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:50</nova:creationTime>
Aug 26 13:11:50 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:50 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:50 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:50 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:user uuid="5c34564d65f640599b8b5c39b2640c91">tempest-AttachSCSIVolumeTestJSON-633590100-project-member</nova:user>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:project uuid="1808f8a1626f4371a3478142569aab21">tempest-AttachSCSIVolumeTestJSON-633590100</nova:project>
Aug 26 13:11:50 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:50 user nova-compute[73503]:       <nova:root type="image" uuid="03e24fa2-1c9f-4014-ad25-11c1b0debd9b"/>
Aug 26 13:11:50 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:50 user nova-compute[73503]:         <nova:port uuid="e3ea59d4-a49e-4cda-a3e3-7de5e19c343c">
Aug 26 13:11:50 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:11:50 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:50 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:50 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:50 user nova-compute[73503]:   </metadata>
Aug 26 13:11:50 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:50 user nova-compute[73503]:     <system>
Aug 26 13:11:50 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:50 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:50 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:50 user nova-compute[73503]:       <entry name="serial">fdc9d288-a75f-452f-b378-c7dcb52d4e6f</entry>
Aug 26 13:11:50 user nova-compute[73503]:       <entry name="uuid">fdc9d288-a75f-452f-b378-c7dcb52d4e6f</entry>
Aug 26 13:11:50 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:50 user nova-compute[73503]:     </system>
Aug 26 13:11:50 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:50 user nova-compute[73503]:   <os>
Aug 26 13:11:50 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:50 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:50 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:50 user nova-compute[73503]:   </os>
Aug 26 13:11:50 user nova-compute[73503]:   <features>
Aug 26 13:11:50 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:50 user nova-compute[73503]:     <apic/>
Aug 26 13:11:50 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:50 user nova-compute[73503]:   </features>
Aug 26 13:11:50 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:50 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:50 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:50 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:50 user nova-compute[73503]:   </clock>
Aug 26 13:11:50 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:50 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:50 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:50 user nova-compute[73503]:   </cpu>
Aug 26 13:11:50 user nova-compute[73503]:   <devices>
Aug 26 13:11:50 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:50 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:50 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk"/>
Aug 26 13:11:50 user nova-compute[73503]:       <target dev="sda" bus="scsi"/>
Aug 26 13:11:50 user nova-compute[73503]:       <address type="drive" controller="0" unit="0"/>
Aug 26 13:11:50 user nova-compute[73503]:     </disk>
Aug 26 13:11:50 user nova-compute[73503]:     <disk type="file" device="cdrom">
Aug 26 13:11:50 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 13:11:50 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.config"/>
Aug 26 13:11:50 user nova-compute[73503]:       <target dev="sdb" bus="scsi"/>
Aug 26 13:11:50 user nova-compute[73503]:       <address type="drive" controller="0" unit="1"/>
Aug 26 13:11:50 user nova-compute[73503]:     </disk>
Aug 26 13:11:50 user nova-compute[73503]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 13:11:50 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:50 user nova-compute[73503]:       <mac address="fa:16:3e:21:9e:63"/>
Aug 26 13:11:50 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:50 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:50 user nova-compute[73503]:       <target dev="tape3ea59d4-a4"/>
Aug 26 13:11:50 user nova-compute[73503]:     </interface>
Aug 26 13:11:50 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:50 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/console.log" append="off"/>
Aug 26 13:11:50 user nova-compute[73503]:     </serial>
Aug 26 13:11:50 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:50 user nova-compute[73503]:     <video>
Aug 26 13:11:50 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:50 user nova-compute[73503]:     </video>
Aug 26 13:11:50 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:50 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:50 user nova-compute[73503]:     </rng>
Aug 26 13:11:50 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:50 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:50 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:50 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:50 user nova-compute[73503]:   </devices>
Aug 26 13:11:50 user nova-compute[73503]: </domain>
Aug 26 13:11:50 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2058072162',display_name='tempest-AttachSCSIVolumeTestJSON-server-2058072162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2058072162',id=8,image_ref='03e24fa2-1c9f-4014-ad25-11c1b0debd9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtvMaB0wRIGuPJFFUHekkQtJGQDkqUFAnFh3HP1aXvuwTfFqZf9CcPT+T8ajyzzAFXKNA9Yp1sXmvoAYuNqfJiGcEZEhNl9m3IU3euE5Sey9lguwUyNYCRIQsITrPdXrw==',key_name='tempest-keypair-1206419595',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1808f8a1626f4371a3478142569aab21',ramdisk_id='',reservation_id='r-2ki0buv0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='03e24fa2-1c9f-4014-ad25-11c1b0debd9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-633590100',owner_user_name='tempest-AttachSCSIVolumeTestJSON-633590100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c34564d65f640599b8b5c39b2640c91',uuid=fdc9d288-a75f-452f-b378-c7dcb52d4e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Converting VIF {"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG os_vif [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3ea59d4-a4, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3ea59d4-a4, col_values=(('external_ids', {'iface-id': 'e3ea59d4-a49e-4cda-a3e3-7de5e19c343c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:9e:63', 'vm-uuid': 'fdc9d288-a75f-452f-b378-c7dcb52d4e6f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:50 user nova-compute[73503]: INFO os_vif [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4')
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No BDM found with device name sda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No VIF found with MAC fa:16:3e:21:9e:63, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Using config drive
Aug 26 13:11:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Creating config drive at /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.config
Aug 26 13:11:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_8m5ea09 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_8m5ea09" returned: 0 in 0.059s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updated VIF entry in instance network info cache for port e3ea59d4-a49e-4cda-a3e3-7de5e19c343c. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updating instance_info_cache with network_info: [{"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9981ac8-bbff-43db-8718-f796635f27e0 req-82043f69-d6ce-4501-adab-9b12af7a97b1 service nova] Releasing lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055511.370886, 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] VM Resumed (Lifecycle Event)
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Instance spawned successfully.
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055511.3714888, 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] VM Started (Lifecycle Event)
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Took 10.51 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:51 user nova-compute[73503]: INFO nova.compute.manager [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Took 12.65 seconds to build instance.
Aug 26 13:11:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a8d76a9c-44f1-4b1d-86f2-eabcc6b8d1e2 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.944s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-201a7529-02b1-49d4-8ee9-ffdfdad06b99 req-f4ed0865-0aa0-4830-a3ea-fc652154176b service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-201a7529-02b1-49d4-8ee9-ffdfdad06b99 req-f4ed0865-0aa0-4830-a3ea-fc652154176b service nova] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-201a7529-02b1-49d4-8ee9-ffdfdad06b99 req-f4ed0865-0aa0-4830-a3ea-fc652154176b service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-201a7529-02b1-49d4-8ee9-ffdfdad06b99 req-f4ed0865-0aa0-4830-a3ea-fc652154176b service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-201a7529-02b1-49d4-8ee9-ffdfdad06b99 req-f4ed0865-0aa0-4830-a3ea-fc652154176b service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] No waiting events found dispatching network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:52 user nova-compute[73503]: WARNING nova.compute.manager [req-201a7529-02b1-49d4-8ee9-ffdfdad06b99 req-f4ed0865-0aa0-4830-a3ea-fc652154176b service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received unexpected event network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c for instance with vm_state building and task_state spawning.
Aug 26 13:11:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:11:53 user nova-compute[73503]: INFO nova.compute.claims [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Claim successful on node user
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.763s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:11:54 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.policy [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dc91bce8f26488ba19fe4392b4b2dc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0999b784caee47ccb23980f5e4a2d788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:11:54 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Creating image(s)
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "/opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "/opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-827b5e5e-8671-41a8-95eb-a2bbad4116bb req-71bbcbd2-dc3f-402b-8b38-c82454264a6d service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-827b5e5e-8671-41a8-95eb-a2bbad4116bb req-71bbcbd2-dc3f-402b-8b38-c82454264a6d service nova] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-827b5e5e-8671-41a8-95eb-a2bbad4116bb req-71bbcbd2-dc3f-402b-8b38-c82454264a6d service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-827b5e5e-8671-41a8-95eb-a2bbad4116bb req-71bbcbd2-dc3f-402b-8b38-c82454264a6d service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-827b5e5e-8671-41a8-95eb-a2bbad4116bb req-71bbcbd2-dc3f-402b-8b38-c82454264a6d service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] No waiting events found dispatching network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:55 user nova-compute[73503]: WARNING nova.compute.manager [req-827b5e5e-8671-41a8-95eb-a2bbad4116bb req-71bbcbd2-dc3f-402b-8b38-c82454264a6d service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received unexpected event network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c for instance with vm_state building and task_state spawning.
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk 1073741824" returned: 0 in 0.081s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055515.2888808, fdc9d288-a75f-452f-b378-c7dcb52d4e6f => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] VM Resumed (Lifecycle Event)
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Instance spawned successfully.
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Successfully created port: b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055515.289473, fdc9d288-a75f-452f-b378-c7dcb52d4e6f => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] VM Started (Lifecycle Event)
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Took 10.64 seconds to spawn the instance on the hypervisor.
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:11:55 user nova-compute[73503]: INFO nova.compute.manager [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Took 11.81 seconds to build instance.
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Cannot resize image /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Ensure instance console log exists: /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-651047c2-6083-4f58-86fe-01d7365947b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.977s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Successfully updated port: b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquired lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-changed-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Refreshing instance network info cache due to event network-changed-b9017999-d716-42ac-96bd-954bb58e009b. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] Acquiring lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:11:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updating instance_info_cache with network_info: [{"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Releasing lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Instance network_info: |[{"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] Acquired lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Refreshing network info cache for port b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Start _get_guest_xml network_info=[{"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:11:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1767187518',display_name='tempest-TestVolumeSwap-server-1767187518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1767187518',id=9,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbQqFsqXR3Ly08xP2TTIt1/9Y7XeqcNBJ9MlIvGwM80ClK/nmmdBD/W7J6CT1zVuhmrS4Frud5F6xkZNzwca+5wwvd2AhXrCRg23Efn0ewZcVCJPm4Q8pm8DdFgWUzRdA==',key_name='tempest-keypair-1361842554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0999b784caee47ccb23980f5e4a2d788',ramdisk_id='',reservation_id='r-b5ko00w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-865966160',owner_user_name='tempest-TestVolumeSwap-865966160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc91bce8f26488ba19fe4392b4b2dc1',uuid=7bf712b0-6ee5-4311-a7e2-d3461af1a8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Converting VIF {"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.objects.instance [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:11:57 user nova-compute[73503]:   <uuid>7bf712b0-6ee5-4311-a7e2-d3461af1a8c6</uuid>
Aug 26 13:11:57 user nova-compute[73503]:   <name>instance-00000009</name>
Aug 26 13:11:57 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:11:57 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:11:57 user nova-compute[73503]:   <metadata>
Aug 26 13:11:57 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:11:57 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:11:57 user nova-compute[73503]:       <nova:name>tempest-TestVolumeSwap-server-1767187518</nova:name>
Aug 26 13:11:57 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:11:57</nova:creationTime>
Aug 26 13:11:57 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:11:57 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:11:57 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:11:57 user nova-compute[73503]:       <nova:owner>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:user uuid="1dc91bce8f26488ba19fe4392b4b2dc1">tempest-TestVolumeSwap-865966160-project-member</nova:user>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:project uuid="0999b784caee47ccb23980f5e4a2d788">tempest-TestVolumeSwap-865966160</nova:project>
Aug 26 13:11:57 user nova-compute[73503]:       </nova:owner>
Aug 26 13:11:57 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:11:57 user nova-compute[73503]:       <nova:ports>
Aug 26 13:11:57 user nova-compute[73503]:         <nova:port uuid="b9017999-d716-42ac-96bd-954bb58e009b">
Aug 26 13:11:57 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 13:11:57 user nova-compute[73503]:         </nova:port>
Aug 26 13:11:57 user nova-compute[73503]:       </nova:ports>
Aug 26 13:11:57 user nova-compute[73503]:     </nova:instance>
Aug 26 13:11:57 user nova-compute[73503]:   </metadata>
Aug 26 13:11:57 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:11:57 user nova-compute[73503]:     <system>
Aug 26 13:11:57 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:11:57 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:11:57 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:11:57 user nova-compute[73503]:       <entry name="serial">7bf712b0-6ee5-4311-a7e2-d3461af1a8c6</entry>
Aug 26 13:11:57 user nova-compute[73503]:       <entry name="uuid">7bf712b0-6ee5-4311-a7e2-d3461af1a8c6</entry>
Aug 26 13:11:57 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:11:57 user nova-compute[73503]:     </system>
Aug 26 13:11:57 user nova-compute[73503]:   </sysinfo>
Aug 26 13:11:57 user nova-compute[73503]:   <os>
Aug 26 13:11:57 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:11:57 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:11:57 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:11:57 user nova-compute[73503]:   </os>
Aug 26 13:11:57 user nova-compute[73503]:   <features>
Aug 26 13:11:57 user nova-compute[73503]:     <acpi/>
Aug 26 13:11:57 user nova-compute[73503]:     <apic/>
Aug 26 13:11:57 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:11:57 user nova-compute[73503]:   </features>
Aug 26 13:11:57 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:11:57 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:11:57 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:11:57 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:11:57 user nova-compute[73503]:   </clock>
Aug 26 13:11:57 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:11:57 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:11:57 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:11:57 user nova-compute[73503]:   </cpu>
Aug 26 13:11:57 user nova-compute[73503]:   <devices>
Aug 26 13:11:57 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:11:57 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:11:57 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk"/>
Aug 26 13:11:57 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:11:57 user nova-compute[73503]:     </disk>
Aug 26 13:11:57 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:11:57 user nova-compute[73503]:       <mac address="fa:16:3e:5b:4a:f2"/>
Aug 26 13:11:57 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:57 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:11:57 user nova-compute[73503]:       <target dev="tapb9017999-d7"/>
Aug 26 13:11:57 user nova-compute[73503]:     </interface>
Aug 26 13:11:57 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:11:57 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/console.log" append="off"/>
Aug 26 13:11:57 user nova-compute[73503]:     </serial>
Aug 26 13:11:57 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:11:57 user nova-compute[73503]:     <video>
Aug 26 13:11:57 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:11:57 user nova-compute[73503]:     </video>
Aug 26 13:11:57 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:11:57 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:11:57 user nova-compute[73503]:     </rng>
Aug 26 13:11:57 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:11:57 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:11:57 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:11:57 user nova-compute[73503]:     </memballoon>
Aug 26 13:11:57 user nova-compute[73503]:   </devices>
Aug 26 13:11:57 user nova-compute[73503]: </domain>
Aug 26 13:11:57 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1767187518',display_name='tempest-TestVolumeSwap-server-1767187518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1767187518',id=9,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbQqFsqXR3Ly08xP2TTIt1/9Y7XeqcNBJ9MlIvGwM80ClK/nmmdBD/W7J6CT1zVuhmrS4Frud5F6xkZNzwca+5wwvd2AhXrCRg23Efn0ewZcVCJPm4Q8pm8DdFgWUzRdA==',key_name='tempest-keypair-1361842554',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0999b784caee47ccb23980f5e4a2d788',ramdisk_id='',reservation_id='r-b5ko00w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-865966160',owner_user_name='tempest-TestVolumeSwap-865966160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc91bce8f26488ba19fe4392b4b2dc1',uuid=7bf712b0-6ee5-4311-a7e2-d3461af1a8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Converting VIF {"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG os_vif [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9017999-d7, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9017999-d7, col_values=(('external_ids', {'iface-id': 'b9017999-d716-42ac-96bd-954bb58e009b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:4a:f2', 'vm-uuid': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:57 user nova-compute[73503]: INFO os_vif [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7')
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] No VIF found with MAC fa:16:3e:5b:4a:f2, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updated VIF entry in instance network info cache for port b9017999-d716-42ac-96bd-954bb58e009b. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updating instance_info_cache with network_info: [{"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:11:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7306df78-73c2-4077-a42b-cfbc1a3fe094 req-8891b894-8c98-4ae6-a168-b5f3c5ac47d6 service nova] Releasing lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:11:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-26ad8fcc-fd49-4fb7-b09a-f689ca8282ee req-2ea45884-2087-4b75-9f17-469a1899f37f service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-26ad8fcc-fd49-4fb7-b09a-f689ca8282ee req-2ea45884-2087-4b75-9f17-469a1899f37f service nova] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-26ad8fcc-fd49-4fb7-b09a-f689ca8282ee req-2ea45884-2087-4b75-9f17-469a1899f37f service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-26ad8fcc-fd49-4fb7-b09a-f689ca8282ee req-2ea45884-2087-4b75-9f17-469a1899f37f service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-26ad8fcc-fd49-4fb7-b09a-f689ca8282ee req-2ea45884-2087-4b75-9f17-469a1899f37f service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] No waiting events found dispatching network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:11:59 user nova-compute[73503]: WARNING nova.compute.manager [req-26ad8fcc-fd49-4fb7-b09a-f689ca8282ee req-2ea45884-2087-4b75-9f17-469a1899f37f service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received unexpected event network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b for instance with vm_state building and task_state spawning.
Aug 26 13:11:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:11:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:00 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-45d0b77a-7c92-416c-a922-092532bcfbcd req-8de59f18-d88d-4073-8801-2d836f5ca77d service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-45d0b77a-7c92-416c-a922-092532bcfbcd req-8de59f18-d88d-4073-8801-2d836f5ca77d service nova] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-45d0b77a-7c92-416c-a922-092532bcfbcd req-8de59f18-d88d-4073-8801-2d836f5ca77d service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-45d0b77a-7c92-416c-a922-092532bcfbcd req-8de59f18-d88d-4073-8801-2d836f5ca77d service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-45d0b77a-7c92-416c-a922-092532bcfbcd req-8de59f18-d88d-4073-8801-2d836f5ca77d service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] No waiting events found dispatching network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:12:01 user nova-compute[73503]: WARNING nova.compute.manager [req-45d0b77a-7c92-416c-a922-092532bcfbcd req-8de59f18-d88d-4073-8801-2d836f5ca77d service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received unexpected event network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b for instance with vm_state building and task_state spawning.
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055521.6955767, 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:12:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] VM Resumed (Lifecycle Event)
Aug 26 13:12:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Instance spawned successfully.
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Skipping network cache update for instance because it is Building. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055521.7077606, 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:12:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] VM Started (Lifecycle Event)
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:12:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:12:01 user nova-compute[73503]: INFO nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Took 7.31 seconds to spawn the instance on the hypervisor.
Aug 26 13:12:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:12:02 user nova-compute[73503]: INFO nova.compute.manager [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Took 8.61 seconds to build instance.
Aug 26 13:12:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f3c314a-ac6a-4999-920f-2f6d690aa18a tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.773s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:12:02 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:12:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "31572195-0924-47ad-bfe5-01a1266da291" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:12:07 user nova-compute[73503]: INFO nova.compute.claims [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Claim successful on node user
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:08 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:12:08 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:12:08 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7276MB free_disk=25.516124725341797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:12:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.297s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.353s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:12:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 31572195-0924-47ad-bfe5-01a1266da291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c3f369bd-c8ef-4b28-9866-3eb1a354f87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.policy [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '400cf575a3734f73a1f3dfa93e03e243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a05138cd9ea425581df7e6169fea3c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:12:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Creating image(s)
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "/opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "/opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "/opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.216s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk 1073741824" returned: 0 in 0.250s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.473s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.334s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Successfully created port: eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Cannot resize image /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Ensure instance console log exists: /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Successfully updated port: eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquired lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received event network-changed-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Refreshing instance network info cache due to event network-changed-eb4a8bdd-f5de-4bad-a723-f063d68954bd. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] Acquiring lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updating instance_info_cache with network_info: [{"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Releasing lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Instance network_info: |[{"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] Acquired lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Refreshing network info cache for port eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Start _get_guest_xml network_info=[{"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:12:12 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:12:12 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-852605157',display_name='tempest-VolumesAssistedSnapshotsTest-server-852605157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-852605157',id=10,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODandm9RHjs3k90mW+zeGfbR0TM0/H2do+pjQk9Rpi0cEUm0wuPMnIy2ESi5VRFjc6JiyaP2DNeslUte1TGtGodj7fcsygyBVIA7xt95EU08B4ojcO7bNYh4MtA93v5VQ==',key_name='tempest-keypair-632134712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a05138cd9ea425581df7e6169fea3c5',ramdisk_id='',reservation_id='r-fd7df3po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-146844530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-146844530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='400cf575a3734f73a1f3dfa93e03e243',uuid=31572195-0924-47ad-bfe5-01a1266da291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Converting VIF {"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lazy-loading 'pci_devices' on Instance uuid 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:12:12 user nova-compute[73503]:   <uuid>31572195-0924-47ad-bfe5-01a1266da291</uuid>
Aug 26 13:12:12 user nova-compute[73503]:   <name>instance-0000000a</name>
Aug 26 13:12:12 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:12:12 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:12:12 user nova-compute[73503]:   <metadata>
Aug 26 13:12:12 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:12:12 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:12:12 user nova-compute[73503]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-852605157</nova:name>
Aug 26 13:12:12 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:12:12</nova:creationTime>
Aug 26 13:12:12 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:12:12 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:12:12 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:12:12 user nova-compute[73503]:       <nova:owner>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:user uuid="400cf575a3734f73a1f3dfa93e03e243">tempest-VolumesAssistedSnapshotsTest-146844530-project-member</nova:user>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:project uuid="9a05138cd9ea425581df7e6169fea3c5">tempest-VolumesAssistedSnapshotsTest-146844530</nova:project>
Aug 26 13:12:12 user nova-compute[73503]:       </nova:owner>
Aug 26 13:12:12 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:12:12 user nova-compute[73503]:       <nova:ports>
Aug 26 13:12:12 user nova-compute[73503]:         <nova:port uuid="eb4a8bdd-f5de-4bad-a723-f063d68954bd">
Aug 26 13:12:12 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 13:12:12 user nova-compute[73503]:         </nova:port>
Aug 26 13:12:12 user nova-compute[73503]:       </nova:ports>
Aug 26 13:12:12 user nova-compute[73503]:     </nova:instance>
Aug 26 13:12:12 user nova-compute[73503]:   </metadata>
Aug 26 13:12:12 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:12:12 user nova-compute[73503]:     <system>
Aug 26 13:12:12 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:12:12 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:12:12 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:12:12 user nova-compute[73503]:       <entry name="serial">31572195-0924-47ad-bfe5-01a1266da291</entry>
Aug 26 13:12:12 user nova-compute[73503]:       <entry name="uuid">31572195-0924-47ad-bfe5-01a1266da291</entry>
Aug 26 13:12:12 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:12:12 user nova-compute[73503]:     </system>
Aug 26 13:12:12 user nova-compute[73503]:   </sysinfo>
Aug 26 13:12:12 user nova-compute[73503]:   <os>
Aug 26 13:12:12 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:12:12 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:12:12 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:12:12 user nova-compute[73503]:   </os>
Aug 26 13:12:12 user nova-compute[73503]:   <features>
Aug 26 13:12:12 user nova-compute[73503]:     <acpi/>
Aug 26 13:12:12 user nova-compute[73503]:     <apic/>
Aug 26 13:12:12 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:12:12 user nova-compute[73503]:   </features>
Aug 26 13:12:12 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:12:12 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:12:12 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:12:12 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:12:12 user nova-compute[73503]:   </clock>
Aug 26 13:12:12 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:12:12 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:12:12 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:12:12 user nova-compute[73503]:   </cpu>
Aug 26 13:12:12 user nova-compute[73503]:   <devices>
Aug 26 13:12:12 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:12:12 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:12:12 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk"/>
Aug 26 13:12:12 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:12:12 user nova-compute[73503]:     </disk>
Aug 26 13:12:12 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:12:12 user nova-compute[73503]:       <mac address="fa:16:3e:7e:9f:18"/>
Aug 26 13:12:12 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:12:12 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:12:12 user nova-compute[73503]:       <target dev="tapeb4a8bdd-f5"/>
Aug 26 13:12:12 user nova-compute[73503]:     </interface>
Aug 26 13:12:12 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:12:12 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/console.log" append="off"/>
Aug 26 13:12:12 user nova-compute[73503]:     </serial>
Aug 26 13:12:12 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:12:12 user nova-compute[73503]:     <video>
Aug 26 13:12:12 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:12:12 user nova-compute[73503]:     </video>
Aug 26 13:12:12 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:12:12 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:12:12 user nova-compute[73503]:     </rng>
Aug 26 13:12:12 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:12:12 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:12:12 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:12:12 user nova-compute[73503]:     </memballoon>
Aug 26 13:12:12 user nova-compute[73503]:   </devices>
Aug 26 13:12:12 user nova-compute[73503]: </domain>
Aug 26 13:12:12 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-852605157',display_name='tempest-VolumesAssistedSnapshotsTest-server-852605157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-852605157',id=10,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODandm9RHjs3k90mW+zeGfbR0TM0/H2do+pjQk9Rpi0cEUm0wuPMnIy2ESi5VRFjc6JiyaP2DNeslUte1TGtGodj7fcsygyBVIA7xt95EU08B4ojcO7bNYh4MtA93v5VQ==',key_name='tempest-keypair-632134712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a05138cd9ea425581df7e6169fea3c5',ramdisk_id='',reservation_id='r-fd7df3po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-146844530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-146844530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='400cf575a3734f73a1f3dfa93e03e243',uuid=31572195-0924-47ad-bfe5-01a1266da291,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Converting VIF {"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG os_vif [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb4a8bdd-f5, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb4a8bdd-f5, col_values=(('external_ids', {'iface-id': 'eb4a8bdd-f5de-4bad-a723-f063d68954bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:9f:18', 'vm-uuid': '31572195-0924-47ad-bfe5-01a1266da291'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:12 user nova-compute[73503]: INFO os_vif [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5')
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] No VIF found with MAC fa:16:3e:7e:9f:18, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updated VIF entry in instance network info cache for port eb4a8bdd-f5de-4bad-a723-f063d68954bd. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updating instance_info_cache with network_info: [{"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25e510a4-9227-439e-825d-ec28e4951846 req-144cdfe2-daec-4f88-bfbe-17ae32ac21ae service nova] Releasing lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-2983567f-5443-4e55-b74e-031ac13691b7 req-74782230-1350-44ce-b8b7-8a162696d2e3 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received event network-vif-plugged-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2983567f-5443-4e55-b74e-031ac13691b7 req-74782230-1350-44ce-b8b7-8a162696d2e3 service nova] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2983567f-5443-4e55-b74e-031ac13691b7 req-74782230-1350-44ce-b8b7-8a162696d2e3 service nova] Lock "31572195-0924-47ad-bfe5-01a1266da291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2983567f-5443-4e55-b74e-031ac13691b7 req-74782230-1350-44ce-b8b7-8a162696d2e3 service nova] Lock "31572195-0924-47ad-bfe5-01a1266da291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-2983567f-5443-4e55-b74e-031ac13691b7 req-74782230-1350-44ce-b8b7-8a162696d2e3 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] No waiting events found dispatching network-vif-plugged-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:12:14 user nova-compute[73503]: WARNING nova.compute.manager [req-2983567f-5443-4e55-b74e-031ac13691b7 req-74782230-1350-44ce-b8b7-8a162696d2e3 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received unexpected event network-vif-plugged-eb4a8bdd-f5de-4bad-a723-f063d68954bd for instance with vm_state building and task_state spawning.
Aug 26 13:12:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-a948bb7b-ca76-4cb8-ac61-7d3403e7458f req-e1a3c90b-7b90-4616-af01-9d87c6e8f056 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received event network-vif-plugged-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a948bb7b-ca76-4cb8-ac61-7d3403e7458f req-e1a3c90b-7b90-4616-af01-9d87c6e8f056 service nova] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a948bb7b-ca76-4cb8-ac61-7d3403e7458f req-e1a3c90b-7b90-4616-af01-9d87c6e8f056 service nova] Lock "31572195-0924-47ad-bfe5-01a1266da291-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a948bb7b-ca76-4cb8-ac61-7d3403e7458f req-e1a3c90b-7b90-4616-af01-9d87c6e8f056 service nova] Lock "31572195-0924-47ad-bfe5-01a1266da291-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-a948bb7b-ca76-4cb8-ac61-7d3403e7458f req-e1a3c90b-7b90-4616-af01-9d87c6e8f056 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] No waiting events found dispatching network-vif-plugged-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:12:16 user nova-compute[73503]: WARNING nova.compute.manager [req-a948bb7b-ca76-4cb8-ac61-7d3403e7458f req-e1a3c90b-7b90-4616-af01-9d87c6e8f056 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received unexpected event network-vif-plugged-eb4a8bdd-f5de-4bad-a723-f063d68954bd for instance with vm_state building and task_state spawning.
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055536.4613938, 31572195-0924-47ad-bfe5-01a1266da291 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] VM Resumed (Lifecycle Event)
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Instance spawned successfully.
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055536.4640443, 31572195-0924-47ad-bfe5-01a1266da291 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] VM Started (Lifecycle Event)
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 26 13:12:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:12:16 user nova-compute[73503]: INFO nova.compute.manager [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Took 9.14 seconds to build instance.
Aug 26 13:12:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0847b3ec-4fac-49ad-adb9-b40400c5bd54 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "31572195-0924-47ad-bfe5-01a1266da291" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.351s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:12:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:43 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:12:43 user nova-compute[73503]: INFO nova.compute.claims [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Claim successful on node user
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:12:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:12:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:12:44 user nova-compute[73503]: INFO nova.virt.block_device [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Booting with volume 31379b54-e24e-468b-94dd-b0ba7ab80885 at /dev/vda
Aug 26 13:12:44 user nova-compute[73503]: DEBUG nova.policy [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac4b7261ce74e05b8ea7defba795dce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc946d3e3fb542dfb75faadf808cacb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:12:44 user nova-compute[73503]: DEBUG os_brick.utils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:12:44 user nova-compute[73503]: INFO oslo.privsep.daemon [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp7rn6pz_u/privsep.sock']
Aug 26 13:12:44 user sudo[84862]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp7rn6pz_u/privsep.sock
Aug 26 13:12:44 user sudo[84862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 13:12:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully created port: a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:12:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully created port: 3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:12:46 user sudo[84862]: pam_unix(sudo:session): session closed for user root
Aug 26 13:12:46 user nova-compute[73503]: INFO oslo.privsep.daemon [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Spawned new privsep daemon via rootwrap
Aug 26 13:12:46 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 13:12:46 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 13:12:46 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 13:12:46 user nova-compute[73503]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84865
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa47260-5ac9-4877-af72-0d7a70b5617e]: (2,) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c61602-b3ce-451f-bbb4-09b4fa248321]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:46 user nova-compute[73503]: WARNING os_brick.initiator.connectors.nvmeof [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1094315e-dbbd-4549-ba24-ee265bf202ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully created port: a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[306c718a-52bf-4dda-805b-5fc1f7d1e5f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[344cbcc0-99b3-410d-bd44-61ee478221e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:12:46 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:12:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9979a60d-6f9f-47c0-86dd-5ffe10f374ab]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG os_brick.utils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== get_connector_properties: return (2117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:12:46 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating existing volume attachment record: c792d24c-d489-4baa-920b-62a7156c7b4e {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:12:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully created port: e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:12:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully created port: eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-a9d5a677-8385-48ba-8d33-3383fdf4f687. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:49 user nova-compute[73503]: DEBUG nova.network.neutron [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-40aedbb5-1718-45a3-a57d-dc3df26568bf req-c4979bad-9153-4413-ba23-995dd56a8e2b service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:49 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: 5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port 5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-f09da7b5-eb41-491e-982d-82de621b3d2a. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-029bc1a9-c8a2-42c6-8c07-6ed188d55b61 req-b2d70bf2-d8ab-478f-8a7c-3448da4cc382 service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: 3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-3be3abba-3873-4b42-b7f4-4aff3910c050. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port 3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.network.neutron [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.network.neutron [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.network.neutron [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG nova.network.neutron [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9fec65bb-a975-4d9b-8b0a-fcb31cf3343a req-87535700-ca6a-446f-b43f-1ff19f6cf45a service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:54 user nova-compute[73503]: INFO nova.compute.manager [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Rescuing
Aug 26 13:12:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG nova.compute.manager [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG nova.compute.manager [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-e5274f9c-7a71-4e3c-9b01-ec0e02738dea. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Successfully updated port: eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-76e268ad-100b-44aa-946e-a64e5f739d22 req-a106d4f8-593e-40b9-a023-ac8cb04a0b4c service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance destroyed successfully.
Aug 26 13:12:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Attempting rescue
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73503) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:12:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Creating image(s)
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'trusted_certs' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue" returned: 0 in 0.052s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'migration_context' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.base [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<abc314fb-c2e8-4060-bd6f-4c8917d4e034> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Start _get_guest_xml network_info=[{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:bc:dc:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'resources' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.base [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<abc314fb-c2e8-4060-bd6f-4c8917d4e034> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'numa_topology' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.base [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<abc314fb-c2e8-4060-bd6f-4c8917d4e034> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:12:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:12:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'vcpu_model' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.base [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<abc314fb-c2e8-4060-bd6f-4c8917d4e034> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-701153657',display_name='tempest-ServerRescueNegativeTestJSON-server-701153657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-701153657',id=3,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-1nshvrsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:21Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=abc314fb-c2e8-4060-bd6f-4c8917d4e034,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:bc:dc:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:bc:dc:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'pci_devices' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.objects.base [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<abc314fb-c2e8-4060-bd6f-4c8917d4e034> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:12:56 user nova-compute[73503]:   <uuid>abc314fb-c2e8-4060-bd6f-4c8917d4e034</uuid>
Aug 26 13:12:56 user nova-compute[73503]:   <name>instance-00000003</name>
Aug 26 13:12:56 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:12:56 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:12:56 user nova-compute[73503]:   <metadata>
Aug 26 13:12:56 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:12:56 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:12:56 user nova-compute[73503]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-701153657</nova:name>
Aug 26 13:12:56 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:12:56</nova:creationTime>
Aug 26 13:12:56 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:12:56 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:12:56 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:12:56 user nova-compute[73503]:       <nova:owner>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:user uuid="9cd5b0cb95ba4c6984a9fe5085c87207">tempest-ServerRescueNegativeTestJSON-993610223-project-member</nova:user>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:project uuid="a84b5b1338f040709bafbe65939ac8e7">tempest-ServerRescueNegativeTestJSON-993610223</nova:project>
Aug 26 13:12:56 user nova-compute[73503]:       </nova:owner>
Aug 26 13:12:56 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:12:56 user nova-compute[73503]:       <nova:ports>
Aug 26 13:12:56 user nova-compute[73503]:         <nova:port uuid="8ffad0c8-4fd7-465a-ba9e-f7362c167ce1">
Aug 26 13:12:56 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:12:56 user nova-compute[73503]:         </nova:port>
Aug 26 13:12:56 user nova-compute[73503]:       </nova:ports>
Aug 26 13:12:56 user nova-compute[73503]:     </nova:instance>
Aug 26 13:12:56 user nova-compute[73503]:   </metadata>
Aug 26 13:12:56 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:12:56 user nova-compute[73503]:     <system>
Aug 26 13:12:56 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:12:56 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:12:56 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:12:56 user nova-compute[73503]:       <entry name="serial">abc314fb-c2e8-4060-bd6f-4c8917d4e034</entry>
Aug 26 13:12:56 user nova-compute[73503]:       <entry name="uuid">abc314fb-c2e8-4060-bd6f-4c8917d4e034</entry>
Aug 26 13:12:56 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:12:56 user nova-compute[73503]:     </system>
Aug 26 13:12:56 user nova-compute[73503]:   </sysinfo>
Aug 26 13:12:56 user nova-compute[73503]:   <os>
Aug 26 13:12:56 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:12:56 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:12:56 user nova-compute[73503]:   </os>
Aug 26 13:12:56 user nova-compute[73503]:   <features>
Aug 26 13:12:56 user nova-compute[73503]:     <acpi/>
Aug 26 13:12:56 user nova-compute[73503]:     <apic/>
Aug 26 13:12:56 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:12:56 user nova-compute[73503]:   </features>
Aug 26 13:12:56 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:12:56 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:12:56 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:12:56 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:12:56 user nova-compute[73503]:   </clock>
Aug 26 13:12:56 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:12:56 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:12:56 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:12:56 user nova-compute[73503]:   </cpu>
Aug 26 13:12:56 user nova-compute[73503]:   <devices>
Aug 26 13:12:56 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:12:56 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:12:56 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue"/>
Aug 26 13:12:56 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:12:56 user nova-compute[73503]:     </disk>
Aug 26 13:12:56 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:12:56 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:12:56 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk"/>
Aug 26 13:12:56 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:12:56 user nova-compute[73503]:     </disk>
Aug 26 13:12:56 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:12:56 user nova-compute[73503]:       <mac address="fa:16:3e:bc:dc:16"/>
Aug 26 13:12:56 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:12:56 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:12:56 user nova-compute[73503]:       <target dev="tap8ffad0c8-4f"/>
Aug 26 13:12:56 user nova-compute[73503]:     </interface>
Aug 26 13:12:56 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:12:56 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/console.log" append="off"/>
Aug 26 13:12:56 user nova-compute[73503]:     </serial>
Aug 26 13:12:56 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:12:56 user nova-compute[73503]:     <video>
Aug 26 13:12:56 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:12:56 user nova-compute[73503]:     </video>
Aug 26 13:12:56 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:12:56 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:12:56 user nova-compute[73503]:     </rng>
Aug 26 13:12:56 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:12:56 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:12:56 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:12:56 user nova-compute[73503]:     </memballoon>
Aug 26 13:12:56 user nova-compute[73503]:   </devices>
Aug 26 13:12:56 user nova-compute[73503]: </domain>
Aug 26 13:12:56 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:12:56 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance destroyed successfully.
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:bc:dc:16, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lazy-loading 'flavor' on Instance uuid c3f369bd-c8ef-4b28-9866-3eb1a354f87e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:57 user nova-compute[73503]: INFO nova.compute.manager [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Attaching volume 7225487b-bb46-4ed5-ac8d-1ba64c75c89a to /dev/vdb
Aug 26 13:12:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG os_brick.utils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c8a590-2b15-4d4b-8cef-119603b4d8d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[74664fe8-7520-4b34-a4e5-4a1aa2e50443]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[066fc3e6-696d-4604-8ddf-d1e528751e79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c25b4-c103-4af8-a913-a1630c6a1017]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:12:57 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:12:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4267b-5f0c-420a-ae18-b43549b7ddb9]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG os_brick.utils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updating existing volume attachment record: 72cca8c2-1ea0-428c-b92c-4eecdb674dde {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:12:58 user nova-compute[73503]: INFO nova.virt.block_device [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Booting with volume 0c1ebe89-27ed-41fa-99f4-32d80615b821 at /dev/vdb
Aug 26 13:12:58 user nova-compute[73503]: DEBUG os_brick.utils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54dc0e2-ca1e-4754-bbbb-507e6ebf7c29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7882273-4b4f-4753-bd07-9579dc90f290]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance network_info: |[{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea3ec7-cc07-4c6e-ba19-f561e818e717]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[019427e0-56b0-4402-b6ce-3412dcb4dd88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:12:58 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:12:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21658ad0-3703-4558-a310-28fbf05ffb8c]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG os_brick.utils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:12:58 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating existing volume attachment record: 023c2eb3-3aaf-4ffb-a17c-0345f1b23a5a {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-19bd9e41-e50e-45e6-ad6c-a4f26b6ca1fa req-1d95ebcf-122d-42e8-8a85-04207e319081 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-19bd9e41-e50e-45e6-ad6c-a4f26b6ca1fa req-1d95ebcf-122d-42e8-8a85-04207e319081 service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-19bd9e41-e50e-45e6-ad6c-a4f26b6ca1fa req-1d95ebcf-122d-42e8-8a85-04207e319081 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-19bd9e41-e50e-45e6-ad6c-a4f26b6ca1fa req-1d95ebcf-122d-42e8-8a85-04207e319081 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-19bd9e41-e50e-45e6-ad6c-a4f26b6ca1fa req-1d95ebcf-122d-42e8-8a85-04207e319081 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:12:59 user nova-compute[73503]: WARNING nova.compute.manager [req-19bd9e41-e50e-45e6-ad6c-a4f26b6ca1fa req-1d95ebcf-122d-42e8-8a85-04207e319081 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state active and task_state rescuing.
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updated VIF entry in instance network info cache for port eabc0f4c-1c64-4c3a-a75a-092cbf4062b0. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-unplugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-unplugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:12:59 user nova-compute[73503]: WARNING nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-unplugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state active and task_state rescuing.
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:12:59 user nova-compute[73503]: WARNING nova.compute.manager [req-7ab530b6-4eb9-42e6-8fbb-9d105c92a666 req-7b27d908-2bc4-40d4-af05-a18648affbbc service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state active and task_state rescuing.
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:12:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:12:59 user nova-compute[73503]: INFO nova.compute.claims [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Claim successful on node user
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for abc314fb-c2e8-4060-bd6f-4c8917d4e034 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055580.1276205, abc314fb-c2e8-4060-bd6f-4c8917d4e034 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:00 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] VM Resumed (Lifecycle Event)
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e5250a4a-5fa8-47cf-8208-45363677148c tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:13:00 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055580.128837, abc314fb-c2e8-4060-bd6f-4c8917d4e034 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:00 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] VM Started (Lifecycle Event)
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:13:00 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:13:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:13:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Creating image(s)
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "/opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "/opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "/opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG nova.policy [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e23ee63bc296443fbe8224f94cff507a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933ef3f76b494bbaabf6511c70fc312c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-a7101061-c163-441a-b426-df9ba0e59c5c req-2899c071-89ce-45fa-90a1-990ae75a4c29 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a7101061-c163-441a-b426-df9ba0e59c5c req-2899c071-89ce-45fa-90a1-990ae75a4c29 service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a7101061-c163-441a-b426-df9ba0e59c5c req-2899c071-89ce-45fa-90a1-990ae75a4c29 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a7101061-c163-441a-b426-df9ba0e59c5c req-2899c071-89ce-45fa-90a1-990ae75a4c29 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-a7101061-c163-441a-b426-df9ba0e59c5c req-2899c071-89ce-45fa-90a1-990ae75a4c29 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:01 user nova-compute[73503]: WARNING nova.compute.manager [req-a7101061-c163-441a-b426-df9ba0e59c5c req-2899c071-89ce-45fa-90a1-990ae75a4c29 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state rescued and task_state None.
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk 1073741824" returned: 0 in 0.066s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Successfully created port: 8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Cannot resize image /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Ensure instance console log exists: /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Successfully updated port: 8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:13:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "refresh_cache-14c53f56-9ab5-428c-80c8-c9deb9271ac6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquired lock "refresh_cache-14c53f56-9ab5-428c-80c8-c9deb9271ac6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:13:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Updating instance_info_cache with network_info: [{"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Releasing lock "refresh_cache-14c53f56-9ab5-428c-80c8-c9deb9271ac6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Instance network_info: |[{"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Start _get_guest_xml network_info=[{"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:13:03 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:13:03 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-changed-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Refreshing instance network info cache due to event network-changed-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] Acquiring lock "refresh_cache-14c53f56-9ab5-428c-80c8-c9deb9271ac6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] Acquired lock "refresh_cache-14c53f56-9ab5-428c-80c8-c9deb9271ac6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Refreshing network info cache for port 8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1054634393',display_name='tempest-ServersNegativeTestJSON-server-1054634393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1054634393',id=12,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='933ef3f76b494bbaabf6511c70fc312c',ramdisk_id='',reservation_id='r-5huy08yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-410549196',owner_user_name='tempest-ServersNegativeTestJSON-410549196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:13:01Z,user_data=None,user_id='e23ee63bc296443fbe8224f94cff507a',uuid=14c53f56-9ab5-428c-80c8-c9deb9271ac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converting VIF {"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.objects.instance [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lazy-loading 'pci_devices' on Instance uuid 14c53f56-9ab5-428c-80c8-c9deb9271ac6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:13:03 user nova-compute[73503]:   <uuid>14c53f56-9ab5-428c-80c8-c9deb9271ac6</uuid>
Aug 26 13:13:03 user nova-compute[73503]:   <name>instance-0000000c</name>
Aug 26 13:13:03 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:13:03 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:13:03 user nova-compute[73503]:   <metadata>
Aug 26 13:13:03 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:13:03 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:13:03 user nova-compute[73503]:       <nova:name>tempest-ServersNegativeTestJSON-server-1054634393</nova:name>
Aug 26 13:13:03 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:13:03</nova:creationTime>
Aug 26 13:13:03 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:13:03 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:13:03 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:13:03 user nova-compute[73503]:       <nova:owner>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:user uuid="e23ee63bc296443fbe8224f94cff507a">tempest-ServersNegativeTestJSON-410549196-project-member</nova:user>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:project uuid="933ef3f76b494bbaabf6511c70fc312c">tempest-ServersNegativeTestJSON-410549196</nova:project>
Aug 26 13:13:03 user nova-compute[73503]:       </nova:owner>
Aug 26 13:13:03 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:13:03 user nova-compute[73503]:       <nova:ports>
Aug 26 13:13:03 user nova-compute[73503]:         <nova:port uuid="8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3">
Aug 26 13:13:03 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:13:03 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:03 user nova-compute[73503]:       </nova:ports>
Aug 26 13:13:03 user nova-compute[73503]:     </nova:instance>
Aug 26 13:13:03 user nova-compute[73503]:   </metadata>
Aug 26 13:13:03 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:13:03 user nova-compute[73503]:     <system>
Aug 26 13:13:03 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:13:03 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:13:03 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:13:03 user nova-compute[73503]:       <entry name="serial">14c53f56-9ab5-428c-80c8-c9deb9271ac6</entry>
Aug 26 13:13:03 user nova-compute[73503]:       <entry name="uuid">14c53f56-9ab5-428c-80c8-c9deb9271ac6</entry>
Aug 26 13:13:03 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:13:03 user nova-compute[73503]:     </system>
Aug 26 13:13:03 user nova-compute[73503]:   </sysinfo>
Aug 26 13:13:03 user nova-compute[73503]:   <os>
Aug 26 13:13:03 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:13:03 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:13:03 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:13:03 user nova-compute[73503]:   </os>
Aug 26 13:13:03 user nova-compute[73503]:   <features>
Aug 26 13:13:03 user nova-compute[73503]:     <acpi/>
Aug 26 13:13:03 user nova-compute[73503]:     <apic/>
Aug 26 13:13:03 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:13:03 user nova-compute[73503]:   </features>
Aug 26 13:13:03 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:13:03 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:13:03 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:13:03 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:13:03 user nova-compute[73503]:   </clock>
Aug 26 13:13:03 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:13:03 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:13:03 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:13:03 user nova-compute[73503]:   </cpu>
Aug 26 13:13:03 user nova-compute[73503]:   <devices>
Aug 26 13:13:03 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:13:03 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:13:03 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk"/>
Aug 26 13:13:03 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:13:03 user nova-compute[73503]:     </disk>
Aug 26 13:13:03 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:03 user nova-compute[73503]:       <mac address="fa:16:3e:d4:34:13"/>
Aug 26 13:13:03 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:03 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:03 user nova-compute[73503]:       <target dev="tap8661d1f3-2e"/>
Aug 26 13:13:03 user nova-compute[73503]:     </interface>
Aug 26 13:13:03 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:13:03 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/console.log" append="off"/>
Aug 26 13:13:03 user nova-compute[73503]:     </serial>
Aug 26 13:13:03 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:13:03 user nova-compute[73503]:     <video>
Aug 26 13:13:03 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:03 user nova-compute[73503]:     </video>
Aug 26 13:13:03 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:13:03 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:13:03 user nova-compute[73503]:     </rng>
Aug 26 13:13:03 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:13:03 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:13:03 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:13:03 user nova-compute[73503]:     </memballoon>
Aug 26 13:13:03 user nova-compute[73503]:   </devices>
Aug 26 13:13:03 user nova-compute[73503]: </domain>
Aug 26 13:13:03 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1054634393',display_name='tempest-ServersNegativeTestJSON-server-1054634393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1054634393',id=12,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='933ef3f76b494bbaabf6511c70fc312c',ramdisk_id='',reservation_id='r-5huy08yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-410549196',owner_user_name='tempest-ServersNegativeTestJSON-410549196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:13:01Z,user_data=None,user_id='e23ee63bc296443fbe8224f94cff507a',uuid=14c53f56-9ab5-428c-80c8-c9deb9271ac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converting VIF {"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG os_vif [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8661d1f3-2e, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8661d1f3-2e, col_values=(('external_ids', {'iface-id': '8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:34:13', 'vm-uuid': '14c53f56-9ab5-428c-80c8-c9deb9271ac6'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:03 user nova-compute[73503]: INFO os_vif [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e')
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] No VIF found with MAC fa:16:3e:d4:34:13, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Updated VIF entry in instance network info cache for port 8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Updating instance_info_cache with network_info: [{"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-396b4036-06fb-4f95-98a3-b98cdc7fbcd5 req-fe182e96-72ed-49eb-b37a-0c5999a230f3 service nova] Releasing lock "refresh_cache-14c53f56-9ab5-428c-80c8-c9deb9271ac6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-26735356-ce97-4ff7-a616-b073fe5995bd req-64400801-e33d-4f74-b18a-8e6d66493291 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-26735356-ce97-4ff7-a616-b073fe5995bd req-64400801-e33d-4f74-b18a-8e6d66493291 service nova] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-26735356-ce97-4ff7-a616-b073fe5995bd req-64400801-e33d-4f74-b18a-8e6d66493291 service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-26735356-ce97-4ff7-a616-b073fe5995bd req-64400801-e33d-4f74-b18a-8e6d66493291 service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-26735356-ce97-4ff7-a616-b073fe5995bd req-64400801-e33d-4f74-b18a-8e6d66493291 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] No waiting events found dispatching network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:05 user nova-compute[73503]: WARNING nova.compute.manager [req-26735356-ce97-4ff7-a616-b073fe5995bd req-64400801-e33d-4f74-b18a-8e6d66493291 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received unexpected event network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 for instance with vm_state building and task_state spawning.
Aug 26 13:13:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updating instance_info_cache with network_info: [{"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c3f369bd-c8ef-4b28-9866-3eb1a354f87e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:13:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-90d61433-3ec1-4c64-b326-b045046250b7 req-9247dea3-d548-48bd-8048-bda5b6df8cb1 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-90d61433-3ec1-4c64-b326-b045046250b7 req-9247dea3-d548-48bd-8048-bda5b6df8cb1 service nova] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-90d61433-3ec1-4c64-b326-b045046250b7 req-9247dea3-d548-48bd-8048-bda5b6df8cb1 service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-90d61433-3ec1-4c64-b326-b045046250b7 req-9247dea3-d548-48bd-8048-bda5b6df8cb1 service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-90d61433-3ec1-4c64-b326-b045046250b7 req-9247dea3-d548-48bd-8048-bda5b6df8cb1 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] No waiting events found dispatching network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:07 user nova-compute[73503]: WARNING nova.compute.manager [req-90d61433-3ec1-4c64-b326-b045046250b7 req-9247dea3-d548-48bd-8048-bda5b6df8cb1 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received unexpected event network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 for instance with vm_state building and task_state spawning.
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055587.6941617, 14c53f56-9ab5-428c-80c8-c9deb9271ac6 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] VM Resumed (Lifecycle Event)
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Instance spawned successfully.
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055587.6979103, 14c53f56-9ab5-428c-80c8-c9deb9271ac6 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] VM Started (Lifecycle Event)
Aug 26 13:13:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 26 13:13:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:13:07 user nova-compute[73503]: INFO nova.compute.manager [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Took 8.19 seconds to build instance.
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ade4af03-1c87-42a0-93e1-4fc7e42c7884 tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.292s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-changed-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Refreshing instance network info cache due to event network-changed-70726c37-f682-40cd-9155-843aca57acf4. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Refreshing network info cache for port 70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.004s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connector [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Factory for ISCSI on None {{(pid=73503) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.010s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJpqeVGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:11 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:11 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:11 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7345f1-c690-4f2a-9a78-f1143fcc6270]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:11 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb90db1-5185-41d4-a197-5a110d2907c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a] added
Aug 26 13:13:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ecf89a-70c2-4b7a-98f9-418a1ffe8cd4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92e9029-1a30-4670-87fb-e1f6a74a1cce]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJpqeVGE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJpqeVGE" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d2d9f0-1812-44cb-8aa1-b5bae8fd4152]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJpqeVGE'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ae15d-3f55-46d6-9a03-96235b9111d8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[632dff0c-fdc0-4449-bdc4-9a9e3a6ab7c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:13:11 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:13:11 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:11 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:13:11 user nova-compute[73503]: 
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[53456d04-a15e-4a74-86eb-2994d534017a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260]
Aug 26 13:13:11 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe69011-1233-4cbc-ba6a-f5121d9ec427]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updated VIF entry in instance network info cache for port 70726c37-f682-40cd-9155-843aca57acf4. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7cd99-545a-4387-b8ea-5869970ad34e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a (non-flash)
Aug 26 13:13:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a (non-flash)
Aug 26 13:13:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cc279a2b-6d73-42d5-a438-d0be6e92f5f6 req-9d1128d4-ace4-4952-b4ce-3a7a98ffe133 service nova] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b851f7d-0bc8-4683-8be4-d6b4dbf46bd8]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJpqeVGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:12 user nova-compute[73503]: INFO nova.virt.block_device [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Booting with volume 96be94ef-4d24-4dcd-a20f-57ade65b1219 at /dev/vdc
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.utils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[715d2efa-a777-40a2-863c-fed6b06807d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed09a0c5-bc92-453c-b07a-0590578fe7f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa85925e-95d0-457e-a0f7-ed7c07188f06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c0048-0868-4b4a-bbe9-2e13f6cdcd09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:12 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905b041-4e5c-4088-b1da-2fcea13c5317]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG os_brick.utils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating existing volume attachment record: 88e6ef37-c9dd-4e93-b3ad-8d88e857ca4c {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-changed-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Refreshing instance network info cache due to event network-changed-8b2435b5-a0f6-40b5-819e-7fb2630cb39e. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Refreshing network info cache for port 8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.771s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] <== connect_volume: return (1774ms) {'type': 'block', 'scsi_wwn': '26533366463636539', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533366463636539', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:13 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:13:13 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=6983MB free_disk=25.417007446289062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lazy-loading 'flavor' on Instance uuid c3f369bd-c8ef-4b28-9866-3eb1a354f87e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:13:13 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:13 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:13:13 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:13:13 user nova-compute[73503]:   <serial>7225487b-bb46-4ed5-ac8d-1ba64c75c89a</serial>
Aug 26 13:13:13 user nova-compute[73503]: </disk>
Aug 26 13:13:13 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c3f369bd-c8ef-4b28-9866-3eb1a354f87e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 31572195-0924-47ad-bfe5-01a1266da291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 14c53f56-9ab5-428c-80c8-c9deb9271ac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.network.neutron [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updated VIF entry in instance network info cache for port 8b2435b5-a0f6-40b5-819e-7fb2630cb39e. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.network.neutron [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-281d5850-6301-476a-8b1e-9d87ae545c42 req-d427d88e-fcfa-4809-aa0b-842e6afa3d21 service nova] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] No VIF found with MAC fa:16:3e:62:4a:15, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9aa3dbf0-58eb-417c-bb75-19928eb5eaaf tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.907s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:14 user nova-compute[73503]: INFO nova.compute.manager [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Terminating instance
Aug 26 13:13:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:13:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-c2c9415f-efc6-443f-bea0-66d4702b47f7 req-6e1b1549-a1e4-49ea-bf0d-1294e702aa3c service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-vif-unplugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c2c9415f-efc6-443f-bea0-66d4702b47f7 req-6e1b1549-a1e4-49ea-bf0d-1294e702aa3c service nova] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c2c9415f-efc6-443f-bea0-66d4702b47f7 req-6e1b1549-a1e4-49ea-bf0d-1294e702aa3c service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c2c9415f-efc6-443f-bea0-66d4702b47f7 req-6e1b1549-a1e4-49ea-bf0d-1294e702aa3c service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-c2c9415f-efc6-443f-bea0-66d4702b47f7 req-6e1b1549-a1e4-49ea-bf0d-1294e702aa3c service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] No waiting events found dispatching network-vif-unplugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-c2c9415f-efc6-443f-bea0-66d4702b47f7 req-6e1b1549-a1e4-49ea-bf0d-1294e702aa3c service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-vif-unplugged-037e80d2-252a-41a1-a9c3-73f0e0449072 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:13:15 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Instance destroyed successfully.
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.objects.instance [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lazy-loading 'resources' on Instance uuid c3f369bd-c8ef-4b28-9866-3eb1a354f87e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1741486291',display_name='tempest-DeleteServersTestJSON-server-1741486291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1741486291',id=2,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf9a969b5e3440d1a243afc140fd3266',ramdisk_id='',reservation_id='r-racl3awd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1708229277',owner_user_name='tempest-DeleteServersTestJSON-1708229277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:11:22Z,user_data=None,user_id='eab46c8dd75e4d66844a6e31aac8068c',uuid=c3f369bd-c8ef-4b28-9866-3eb1a354f87e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Converting VIF {"id": "037e80d2-252a-41a1-a9c3-73f0e0449072", "address": "fa:16:3e:62:4a:15", "network": {"id": "4a7b6829-6a92-4ca9-bce7-0ec29996c29a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-731265198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf9a969b5e3440d1a243afc140fd3266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e80d2-25", "ovs_interfaceid": "037e80d2-252a-41a1-a9c3-73f0e0449072", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_vif [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap037e80d2-25, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:15 user nova-compute[73503]: INFO os_vif [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:4a:15,bridge_name='br-int',has_traffic_filtering=True,id=037e80d2-252a-41a1-a9c3-73f0e0449072,network=Network(4a7b6829-6a92-4ca9-bce7-0ec29996c29a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e80d2-25')
Aug 26 13:13:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJpqeVGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2652a910-389e-4116-b0c0-371a1adbb7af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb688e8-87c2-4bf0-834f-7e70aebebabd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a (non-flash)
Aug 26 13:13:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a (non-flash)
Aug 26 13:13:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd314222830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[74873382-4869-4962-a706-4ae252499933]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76337201-fc8a-4ecd-a3e1-84eaa3de80f8]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2583e4-3da4-44db-8bfd-e99ba1e9af39]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:13:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e199b-aaa0-42f0-ad37-135e6e92fcc8]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091e333-4bfe-4bf3-9089-e48e5c744547]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed6f47-5af6-426b-9b4f-a3b51bd5ecce]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260]
Aug 26 13:13:16 user nova-compute[73503]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7225487b-bb46-4ed5-ac8d-1ba64c75c89a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77830154-53b5-43d7-bb68-d221a805678d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] <== disconnect_volume: return (295ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:13:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Deleting instance files /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e_del
Aug 26 13:13:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Deletion of /opt/stack/data/nova/instances/c3f369bd-c8ef-4b28-9866-3eb1a354f87e_del complete
Aug 26 13:13:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73503) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 13:13:16 user nova-compute[73503]: INFO nova.virt.libvirt.host [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] UEFI support detected
Aug 26 13:13:16 user nova-compute[73503]: INFO nova.compute.manager [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 26 13:13:16 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:16 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:16 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Took 0.64 seconds to deallocate network for instance.
Aug 26 13:13:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] Acquiring lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] No waiting events found dispatching network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:17 user nova-compute[73503]: WARNING nova.compute.manager [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received unexpected event network-vif-plugged-037e80d2-252a-41a1-a9c3-73f0e0449072 for instance with vm_state active and task_state deleting.
Aug 26 13:13:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-6f699247-cc9f-4323-be36-012307925104 req-0af0294d-6dc6-4495-a1e0-c16fc3832855 service nova] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Received event network-vif-deleted-037e80d2-252a-41a1-a9c3-73f0e0449072 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:17 user nova-compute[73503]: INFO nova.compute.manager [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Took 0.86 seconds to detach 1 volumes for instance.
Aug 26 13:13:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:18 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:13:18 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:13:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:18 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Deleted allocations for instance c3f369bd-c8ef-4b28-9866-3eb1a354f87e
Aug 26 13:13:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c9f9e027-d4e3-45f4-9d8e-724e1347ba16 tempest-DeleteServersTestJSON-1708229277 tempest-DeleteServersTestJSON-1708229277-project-member] Lock "c3f369bd-c8ef-4b28-9866-3eb1a354f87e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.515s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:13:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Creating image(s)
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Ensure instance console log exists: /opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Start _get_guest_xml network_info=[{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTdEPZMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64455011-34cc-42fb-8e2a-4fcd9edb24cf', 'attached_at': '', 'detached_at': '', 'volume_id': '31379b54-e24e-468b-94dd-b0ba7ab80885', 'serial': '31379b54-e24e-468b-94dd-b0ba7ab80885'}, 'attachment_id': 'c792d24c-d489-4baa-920b-62a7156c7b4e', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpNirOwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64455011-34cc-42fb-8e2a-4fcd9edb24cf', 'attached_at': '', 'detached_at': '', 'volume_id': '0c1ebe89-27ed-41fa-99f4-32d80615b821', 'serial': '0c1ebe89-27ed-41fa-99f4-32d80615b821'}, 'attachment_id': '023c2eb3-3aaf-4ffb-a17c-0345f1b23a5a', 'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpOCEyle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64455011-34cc-42fb-8e2a-4fcd9edb24cf', 'attached_at': '', 'detached_at': '', 'volume_id': '96be94ef-4d24-4dcd-a20f-57ade65b1219', 'serial': '96be94ef-4d24-4dcd-a20f-57ade65b1219'}, 'attachment_id': '88e6ef37-c9dd-4e93-b3ad-8d88e857ca4c', 'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:13:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:13:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTdEPZMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:24 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439e5e6-3c2f-4f48-8e4e-1f617b3f8c46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:24 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b2e2b4-9271-4c77-a63d-afe79516eb5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885] added
Aug 26 13:13:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b1f17-3c25-4eef-9e0c-fe2e6d8485d1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf823c-82f8-48f1-9718-615938310aae]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTdEPZMA {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTdEPZMA" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9452d89-b3e8-45a6-a4ff-260a77702394]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTdEPZMA'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb282c6-200b-4a56-9181-d89eb7913a22]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84e4063-f3b4-49a9-9801-8d5151d60677]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:13:24 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:13:24 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:13:24 user nova-compute[73503]: 
Aug 26 13:13:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5419fb-66b2-4966-8792-1461590f4f5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260]
Aug 26 13:13:25 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9786efd0-92fb-4c27-8887-a8ff671df600]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f783b0-bbe2-4897-bae9-3189006335fa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f23aac-8708-48cb-a2b6-5861d36fe8b1]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTdEPZMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26133396261633033', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133396261633033', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpNirOwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:26 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:26 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:26 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed547eb-2a8f-498e-9366-505eaf493031]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:26 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b15a46-5d3c-42b2-845b-a362d9fcd1d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821] added
Aug 26 13:13:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1237ef-8177-46c1-8ec0-0a52b26de3bf]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[692bca07-81d9-402f-939e-63ca5b56618c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JpNirOwc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JpNirOwc" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[75984fe7-ff6f-4aee-9c7c-100e4c1114c2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JpNirOwc'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4f562-8d91-4bef-bbee-b2043a0bd098]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb92d12-832e-49cf-ae13-fb8000e31ea4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c60ac-e890-4c6d-b768-34928484ebca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260]
Aug 26 13:13:26 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6746430b-71d0-4936-a9c5-3139d3d49c1b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fa2b2-b493-4c33-b48e-8406f5dd14f0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:26 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:26 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0315a7-09ed-46e0-80f1-df9b5453af4a]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpNirOwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23863383830313837', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863383830313837', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpOCEyle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:27 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:27 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:27 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a5493-fff7-4dff-a042-849264430af8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:27 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aaa71b-3940-4142-99bf-1db61063899c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219] added
Aug 26 13:13:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fefeeef-19fe-4ed1-a0dc-b22c56733d5a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d182c-8418-4b6b-95e4-45407c966b02]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpOCEyle {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XpOCEyle" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[473134f7-1079-43ec-8fec-6b71a597cd44]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XpOCEyle'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0afa4c-f988-498c-8dfe-89137a54f069]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf949c-7fae-44c5-90bb-6f583a896ec0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b76fc-c8e3-492e-902a-3f698da57422]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260]
Aug 26 13:13:27 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14c4a78-ab86-4b26-a00d-7f397084d773]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c508362b-6ec0-435b-b95b-394fc9e7eba3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[02870a5c-518c-44a8-8e12-ae855462f650]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpOCEyle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26133323965396430', 'path': '/dev/sdd'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133323965396430', 'path': '/dev/sdd'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lazy-loading 'pci_devices' on Instance uuid 64455011-34cc-42fb-8e2a-4fcd9edb24cf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:13:28 user nova-compute[73503]:   <uuid>64455011-34cc-42fb-8e2a-4fcd9edb24cf</uuid>
Aug 26 13:13:28 user nova-compute[73503]:   <name>instance-0000000b</name>
Aug 26 13:13:28 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:13:28 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:13:28 user nova-compute[73503]:   <metadata>
Aug 26 13:13:28 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:13:28 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:13:28 user nova-compute[73503]:       <nova:name>tempest-device-tagging-server-1891148154</nova:name>
Aug 26 13:13:28 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:13:24</nova:creationTime>
Aug 26 13:13:28 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:13:28 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:13:28 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:13:28 user nova-compute[73503]:       <nova:owner>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:user uuid="9ac4b7261ce74e05b8ea7defba795dce">tempest-TaggedBootDevicesTest-1781926347-project-member</nova:user>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:project uuid="fc946d3e3fb542dfb75faadf808cacb9">tempest-TaggedBootDevicesTest-1781926347</nova:project>
Aug 26 13:13:28 user nova-compute[73503]:       </nova:owner>
Aug 26 13:13:28 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:13:28 user nova-compute[73503]:       <nova:ports>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="a9d5a677-8385-48ba-8d33-3383fdf4f687">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="f09da7b5-eb41-491e-982d-82de621b3d2a">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="3be3abba-3873-4b42-b7f4-4aff3910c050">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="e5274f9c-7a71-4e3c-9b01-ec0e02738dea">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:         <nova:port uuid="eabc0f4c-1c64-4c3a-a75a-092cbf4062b0">
Aug 26 13:13:28 user nova-compute[73503]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 13:13:28 user nova-compute[73503]:         </nova:port>
Aug 26 13:13:28 user nova-compute[73503]:       </nova:ports>
Aug 26 13:13:28 user nova-compute[73503]:     </nova:instance>
Aug 26 13:13:28 user nova-compute[73503]:   </metadata>
Aug 26 13:13:28 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:13:28 user nova-compute[73503]:     <system>
Aug 26 13:13:28 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:13:28 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:13:28 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:13:28 user nova-compute[73503]:       <entry name="serial">64455011-34cc-42fb-8e2a-4fcd9edb24cf</entry>
Aug 26 13:13:28 user nova-compute[73503]:       <entry name="uuid">64455011-34cc-42fb-8e2a-4fcd9edb24cf</entry>
Aug 26 13:13:28 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:13:28 user nova-compute[73503]:     </system>
Aug 26 13:13:28 user nova-compute[73503]:   </sysinfo>
Aug 26 13:13:28 user nova-compute[73503]:   <os>
Aug 26 13:13:28 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:13:28 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:13:28 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:13:28 user nova-compute[73503]:   </os>
Aug 26 13:13:28 user nova-compute[73503]:   <features>
Aug 26 13:13:28 user nova-compute[73503]:     <acpi/>
Aug 26 13:13:28 user nova-compute[73503]:     <apic/>
Aug 26 13:13:28 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:13:28 user nova-compute[73503]:   </features>
Aug 26 13:13:28 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:13:28 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:13:28 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:13:28 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:13:28 user nova-compute[73503]:   </clock>
Aug 26 13:13:28 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:13:28 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:13:28 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:13:28 user nova-compute[73503]:   </cpu>
Aug 26 13:13:28 user nova-compute[73503]:   <devices>
Aug 26 13:13:28 user nova-compute[73503]:     <disk type="file" device="cdrom">
Aug 26 13:13:28 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 13:13:28 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf/disk.config"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="hda" bus="ide"/>
Aug 26 13:13:28 user nova-compute[73503]:     </disk>
Aug 26 13:13:28 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:13:28 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:28 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <serial>31379b54-e24e-468b-94dd-b0ba7ab80885</serial>
Aug 26 13:13:28 user nova-compute[73503]:     </disk>
Aug 26 13:13:28 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:13:28 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:28 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <serial>0c1ebe89-27ed-41fa-99f4-32d80615b821</serial>
Aug 26 13:13:28 user nova-compute[73503]:     </disk>
Aug 26 13:13:28 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:13:28 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:28 user nova-compute[73503]:       <source dev="/dev/sdd"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="vdc" bus="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <serial>96be94ef-4d24-4dcd-a20f-57ade65b1219</serial>
Aug 26 13:13:28 user nova-compute[73503]:     </disk>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:2e:0e:7a"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tapa9d5a677-83"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:0d:7b:49"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tap5f5717c8-c1"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:3a:9f:f7"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tapf09da7b5-eb"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:89:b3:c3"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tap3be3abba-38"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:ab:0a:69"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tapa4416f37-c3"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:4b:ac:00"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tape5274f9c-7a"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:13:28 user nova-compute[73503]:       <mac address="fa:16:3e:f1:30:45"/>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:13:28 user nova-compute[73503]:       <target dev="tapeabc0f4c-1c"/>
Aug 26 13:13:28 user nova-compute[73503]:     </interface>
Aug 26 13:13:28 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:13:28 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf/console.log" append="off"/>
Aug 26 13:13:28 user nova-compute[73503]:     </serial>
Aug 26 13:13:28 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:13:28 user nova-compute[73503]:     <video>
Aug 26 13:13:28 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:13:28 user nova-compute[73503]:     </video>
Aug 26 13:13:28 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:13:28 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:13:28 user nova-compute[73503]:     </rng>
Aug 26 13:13:28 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:13:28 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:13:28 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:13:28 user nova-compute[73503]:     </memballoon>
Aug 26 13:13:28 user nova-compute[73503]:   </devices>
Aug 26 13:13:28 user nova-compute[73503]: </domain>
Aug 26 13:13:28 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9d5a677-83, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9d5a677-83, col_values=(('external_ids', {'iface-id': 'a9d5a677-8385-48ba-8d33-3383fdf4f687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:0e:7a', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83')
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f5717c8-c1, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f5717c8-c1, col_values=(('external_ids', {'iface-id': '5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:7b:49', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1')
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf09da7b5-eb, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf09da7b5-eb, col_values=(('external_ids', {'iface-id': 'f09da7b5-eb41-491e-982d-82de621b3d2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:9f:f7', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb')
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3be3abba-38, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3be3abba-38, col_values=(('external_ids', {'iface-id': '3be3abba-3873-4b42-b7f4-4aff3910c050', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:b3:c3', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38')
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4416f37-c3, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4416f37-c3, col_values=(('external_ids', {'iface-id': 'a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:0a:69', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3')
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5274f9c-7a, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5274f9c-7a, col_values=(('external_ids', {'iface-id': 'e5274f9c-7a71-4e3c-9b01-ec0e02738dea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:ac:00', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a')
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeabc0f4c-1c, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeabc0f4c-1c, col_values=(('external_ids', {'iface-id': 'eabc0f4c-1c64-4c3a-a75a-092cbf4062b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:30:45', 'vm-uuid': '64455011-34cc-42fb-8e2a-4fcd9edb24cf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:29 user nova-compute[73503]: INFO os_vif [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c')
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] No BDM found with device name hda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] No VIF found with MAC fa:16:3e:2e:0e:7a, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] No VIF found with MAC fa:16:3e:ab:0a:69, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:13:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Using config drive
Aug 26 13:13:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Creating config drive at /opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf/disk.config
Aug 26 13:13:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiqwup_iu {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpiqwup_iu" returned: 0 in 0.062s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-changed-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Refreshing instance network info cache due to event network-changed-adb80339-d391-4325-a8f9-f08a6a202667. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] Acquiring lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] Acquired lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:30 user nova-compute[73503]: DEBUG nova.network.neutron [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Refreshing network info cache for port adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:30 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055595.753889, c3f369bd-c8ef-4b28-9866-3eb1a354f87e => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:30 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] VM Stopped (Lifecycle Event)
Aug 26 13:13:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a4499548-90e5-47b9-86e1-4db39181ec04 None None] [instance: c3f369bd-c8ef-4b28-9866-3eb1a354f87e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updated VIF entry in instance network info cache for port adb80339-d391-4325-a8f9-f08a6a202667. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updating instance_info_cache with network_info: [{"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-225b7c3d-824e-433f-952d-84f13d9c1e33 req-dff3bb3c-be4e-46cb-b222-0b164aab436f service nova] Releasing lock "refresh_cache-0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-f28e88b3-2a2b-4b8c-ac0f-75a9c6788d18 req-b3de97af-f5a6-4b02-919f-17e39ce93d22 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f28e88b3-2a2b-4b8c-ac0f-75a9c6788d18 req-b3de97af-f5a6-4b02-919f-17e39ce93d22 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f28e88b3-2a2b-4b8c-ac0f-75a9c6788d18 req-b3de97af-f5a6-4b02-919f-17e39ce93d22 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f28e88b3-2a2b-4b8c-ac0f-75a9c6788d18 req-b3de97af-f5a6-4b02-919f-17e39ce93d22 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-f28e88b3-2a2b-4b8c-ac0f-75a9c6788d18 req-b3de97af-f5a6-4b02-919f-17e39ce93d22 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:31 user nova-compute[73503]: WARNING nova.compute.manager [req-f28e88b3-2a2b-4b8c-ac0f-75a9c6788d18 req-b3de97af-f5a6-4b02-919f-17e39ce93d22 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 for instance with vm_state building and task_state spawning.
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:32 user nova-compute[73503]: WARNING nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 for instance with vm_state building and task_state spawning.
Aug 26 13:13:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:32 user nova-compute[73503]: WARNING nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 for instance with vm_state building and task_state spawning.
Aug 26 13:13:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:32 user nova-compute[73503]: WARNING nova.compute.manager [req-1e652b81-a34e-4653-8898-d706971525dd req-5c3626cb-3a33-4181-bd59-477b3217713b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a for instance with vm_state building and task_state spawning.
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-85ce8f94-f396-4bd8-8cf8-0739edc78c21 req-b8714b70-a676-434a-91bd-9e9af58cd873 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85ce8f94-f396-4bd8-8cf8-0739edc78c21 req-b8714b70-a676-434a-91bd-9e9af58cd873 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85ce8f94-f396-4bd8-8cf8-0739edc78c21 req-b8714b70-a676-434a-91bd-9e9af58cd873 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85ce8f94-f396-4bd8-8cf8-0739edc78c21 req-b8714b70-a676-434a-91bd-9e9af58cd873 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-85ce8f94-f396-4bd8-8cf8-0739edc78c21 req-b8714b70-a676-434a-91bd-9e9af58cd873 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:33 user nova-compute[73503]: WARNING nova.compute.manager [req-85ce8f94-f396-4bd8-8cf8-0739edc78c21 req-b8714b70-a676-434a-91bd-9e9af58cd873 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b for instance with vm_state building and task_state spawning.
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-1d808d95-cd71-41d4-8a2a-d2e7eff8869d req-94be67e7-961e-48d0-96e6-eac877cc58c5 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1d808d95-cd71-41d4-8a2a-d2e7eff8869d req-94be67e7-961e-48d0-96e6-eac877cc58c5 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1d808d95-cd71-41d4-8a2a-d2e7eff8869d req-94be67e7-961e-48d0-96e6-eac877cc58c5 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1d808d95-cd71-41d4-8a2a-d2e7eff8869d req-94be67e7-961e-48d0-96e6-eac877cc58c5 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-1d808d95-cd71-41d4-8a2a-d2e7eff8869d req-94be67e7-961e-48d0-96e6-eac877cc58c5 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:33 user nova-compute[73503]: WARNING nova.compute.manager [req-1d808d95-cd71-41d4-8a2a-d2e7eff8869d req-94be67e7-961e-48d0-96e6-eac877cc58c5 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 for instance with vm_state building and task_state spawning.
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:34 user nova-compute[73503]: WARNING nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a for instance with vm_state building and task_state spawning.
Aug 26 13:13:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:34 user nova-compute[73503]: WARNING nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 for instance with vm_state building and task_state spawning.
Aug 26 13:13:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:34 user nova-compute[73503]: WARNING nova.compute.manager [req-6b5924a6-c895-4b27-a00c-6475dc41170a req-a6d888e8-2f4b-4f1a-bb8c-d238b0601483 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 for instance with vm_state building and task_state spawning.
Aug 26 13:13:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'flavor' on Instance uuid 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:35 user nova-compute[73503]: WARNING nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b for instance with vm_state building and task_state spawning.
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:35 user nova-compute[73503]: WARNING nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea for instance with vm_state building and task_state spawning.
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:35 user nova-compute[73503]: WARNING nova.compute.manager [req-4278e85b-6dd2-40ba-89ca-ce0b1f0cea99 req-7fba00f7-e46f-497f-b66d-e395d7a214c3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea for instance with vm_state building and task_state spawning.
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: INFO nova.compute.manager [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Attaching volume 883a1edf-5115-48fa-9f9b-47f132b6ab00 to /dev/vdb
Aug 26 13:13:35 user nova-compute[73503]: DEBUG os_brick.utils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b44c46-9ec0-4467-88da-be3521805c2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2c95c2-8d0a-415c-931f-7a6e30a18821]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb87754-5072-45e1-8e8e-1a6021ebf744]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18dac03-fc83-4e7c-9857-e81438db8534]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:35 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2b50a-7829-4c93-9d34-08ba589a4d38]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG os_brick.utils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updating existing volume attachment record: f53090a7-49fa-4db2-8194-73f410080334 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:35 user nova-compute[73503]: WARNING nova.compute.manager [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 for instance with vm_state building and task_state spawning.
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:13:35 user nova-compute[73503]: WARNING nova.compute.manager [req-902353da-e029-4931-a3f6-b0452647503a req-b3e30fb7-ee36-41fd-966f-c0108e3f2da3 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 for instance with vm_state building and task_state spawning.
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055616.0256426, 64455011-34cc-42fb-8e2a-4fcd9edb24cf => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] VM Resumed (Lifecycle Event)
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance spawned successfully.
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055616.0313826, 64455011-34cc-42fb-8e2a-4fcd9edb24cf => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] VM Started (Lifecycle Event)
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:13:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Took 11.83 seconds to spawn the instance on the hypervisor.
Aug 26 13:13:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:13:36 user nova-compute[73503]: INFO nova.compute.manager [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Took 53.02 seconds to build instance.
Aug 26 13:13:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0939a7dd-6634-4358-a4e4-7d3074615fb8 tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.114s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-changed-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Refreshing instance network info cache due to event network-changed-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] Acquiring lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] Acquired lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Refreshing network info cache for port e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updated VIF entry in instance network info cache for port e3ea59d4-a49e-4cda-a3e3-7de5e19c343c. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updating instance_info_cache with network_info: [{"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-60183fda-26c7-44b1-bcc2-68dacb3b4132 req-23ac1979-8ee2-4377-b8fc-336e1ce08e47 service nova] Releasing lock "refresh_cache-fdc9d288-a75f-452f-b378-c7dcb52d4e6f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lazy-loading 'flavor' on Instance uuid fdc9d288-a75f-452f-b378-c7dcb52d4e6f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:40 user nova-compute[73503]: INFO nova.compute.manager [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Attaching volume 1793b552-b90f-48ac-9a07-2f76960aa716 to /dev/sdc
Aug 26 13:13:40 user nova-compute[73503]: DEBUG os_brick.utils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b0ef2-c497-49f0-82e0-74cf45f73b21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028df46-001a-4c41-bcff-155867cbc761]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa605f03-5ef3-4948-8569-561bb9dda033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc71d83-11c0-4190-8c7d-359628e6fc26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:40 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:13:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9b542e-4f76-40e3-9f6c-5ac36bda8ca1]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG os_brick.utils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:40 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updating existing volume attachment record: fc903d9e-792b-465b-99c8-614b8a09bc33 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:13:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-changed-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Refreshing instance network info cache due to event network-changed-b9017999-d716-42ac-96bd-954bb58e009b. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] Acquiring lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] Acquired lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Refreshing network info cache for port b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lazy-loading 'flavor' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:44 user nova-compute[73503]: INFO nova.compute.manager [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Attaching volume 052d96e8-29e2-432b-aa13-96b723199bf1 to /dev/vdb
Aug 26 13:13:45 user nova-compute[73503]: DEBUG os_brick.utils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81bdd39-9220-45f4-85f7-22f4ac64e2b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abcc22f-31f3-4c5f-9557-60b1b34ccf43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updated VIF entry in instance network info cache for port b9017999-d716-42ac-96bd-954bb58e009b. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updating instance_info_cache with network_info: [{"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e3fabb-9720-45cb-af7b-b0c42763b0af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602639a-472c-4403-8b20-a4e2a82fceb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2d94448-e844-4d3e-9db6-f36f79004a6b req-c4e10368-4f62-4105-b671-6845d8374459 service nova] Releasing lock "refresh_cache-7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:45 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:13:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b7421-faf7-4b07-800f-4ed9d9ee44e4]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG os_brick.utils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:45 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updating existing volume attachment record: 8699ba92-385f-4d32-a188-43e790cbdcb2 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:13:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voKzENaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:47 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:47 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:47 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[315d065c-8ccb-4666-b0d2-0bf8eab73c87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:47 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4543230e-0b09-4edd-92c8-1d4ac41bf142]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00] added
Aug 26 13:13:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e795224a-0fa0-42cb-9592-b282eb674692]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b9937-1bf2-4d19-b5c8-92b1ed88437a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voKzENaY {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voKzENaY" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe438a8e-263f-4948-9d9a-e81bc90470c3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voKzENaY'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d0a95-c921-47ab-8d4e-c68d73fa97f5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65606df-adb6-4dab-9160-b259338abdf4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:47 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:47 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:47 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:47 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a5f2b-2376-45f0-a536-0ad5b2dbe6db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260]
Aug 26 13:13:48 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69da7b74-8afb-4450-aa22-04470fd014cc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b4131-5c72-44e6-aeaa-fc29918dabe7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 (non-flash)
Aug 26 13:13:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f2f5b-7c52-4560-89bc-65a4ebacafa1]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voKzENaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23261643533623663', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261643533623663', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'flavor' on Instance uuid 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:13:49 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:49 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:49 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:13:49 user nova-compute[73503]:   <serial>883a1edf-5115-48fa-9f9b-47f132b6ab00</serial>
Aug 26 13:13:49 user nova-compute[73503]: </disk>
Aug 26 13:13:49 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No VIF found with MAC fa:16:3e:df:6d:0a, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:13:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b40f63f9-4ea9-43ad-bba1-bb2965e038bd tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.520s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Detaching volume 883a1edf-5115-48fa-9f9b-47f132b6ab00
Aug 26 13:13:51 user nova-compute[73503]: INFO nova.virt.block_device [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Attempting to driver detach volume 883a1edf-5115-48fa-9f9b-47f132b6ab00 from mountpoint /dev/vdb
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Attempting to detach device vdb from instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:13:51 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:51 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:51 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:13:51 user nova-compute[73503]:   <serial>883a1edf-5115-48fa-9f9b-47f132b6ab00</serial>
Aug 26 13:13:51 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:13:51 user nova-compute[73503]: </disk>
Aug 26 13:13:51 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:13:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Successfully detached device vdb from instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 from the persistent domain config.
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:13:51 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:51 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:51 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:13:51 user nova-compute[73503]:   <serial>883a1edf-5115-48fa-9f9b-47f132b6ab00</serial>
Aug 26 13:13:51 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:13:51 user nova-compute[73503]: </disk>
Aug 26 13:13:51 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693055631.620161, 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:13:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Successfully detached device vdb from instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 from the live domain config.
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voKzENaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:51 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[42482b71-4560-460b-a68f-6dffb511d8dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c491602e-4132-4e77-b458-2e72d0bb763d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 (non-flash)
Aug 26 13:13:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3141fa9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[22243134-7e79-4ac7-b6be-6ba328709acc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3690452-1bc4-4f35-bfa4-ad40655fc4e7]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801728c-4902-46a1-84eb-650d46c34a8d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e794fe8e-462b-4060-8f5e-13b402511d35]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[954f5e0a-725c-4e1f-9f48-070abd91f883]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903309b-e904-441a-a5a9-76e22328abab]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260]
Aug 26 13:13:51 user nova-compute[73503]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883a1edf-5115-48fa-9f9b-47f132b6ab00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0676f9c3-f23a-4b97-8971-66c00848504a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] <== disconnect_volume: return (279ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:13:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'flavor' on Instance uuid 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b3532715-ed0e-4d53-8502-a2b27353ce95 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.870s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHxdeJiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:53 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:53 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:53 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ef5da7-44c2-49f9-a07a-48e065acfd44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:53 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c141d0b-c5e9-4e22-80bf-569542dbfee0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716] added
Aug 26 13:13:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12089ca-cbc6-49b4-92e8-9cb1476cf075]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6868461-6f05-4b39-ad9d-7e89b94aaafa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHxdeJiY {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHxdeJiY" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e18617-0e77-43bf-a4f3-1a99e9034f92]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CHxdeJiY'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2047abf3-c22e-431e-8b30-33555a979c34]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f3859-ea2c-48c6-bbca-533b92cbc511]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fada415-bab2-4f37-bdd2-562319e2efd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260]
Aug 26 13:13:54 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc2417a-4bc2-4167-b71f-95dad5236b0a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dca989-c61b-48e2-ad45-802d422d14de]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 (non-flash)
Aug 26 13:13:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d726804f-044d-4325-9fdd-849f6b6dda77]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHxdeJiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23862306665386137', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862306665386137', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lazy-loading 'flavor' on Instance uuid fdc9d288-a75f-452f-b378-c7dcb52d4e6f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:13:55 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:55 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:55 user nova-compute[73503]:   <target dev="sdc" bus="scsi"/>
Aug 26 13:13:55 user nova-compute[73503]:   <serial>1793b552-b90f-48ac-9a07-2f76960aa716</serial>
Aug 26 13:13:55 user nova-compute[73503]:   <address type="drive" controller="0" unit="2"/>
Aug 26 13:13:55 user nova-compute[73503]: </disk>
Aug 26 13:13:55 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No BDM found with device name sda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:13:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] No VIF found with MAC fa:16:3e:21:9e:63, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:13:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9af7d077-cfaa-4dd0-a85e-06639e7576e0 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.221s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:56 user nova-compute[73503]: INFO nova.compute.manager [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Detaching volume 1793b552-b90f-48ac-9a07-2f76960aa716
Aug 26 13:13:56 user nova-compute[73503]: INFO nova.virt.block_device [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Attempting to driver detach volume 1793b552-b90f-48ac-9a07-2f76960aa716 from mountpoint /dev/sdc
Aug 26 13:13:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Attempting to detach device sdc from instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:13:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:13:56 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:56 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:56 user nova-compute[73503]:   <target dev="sdc" bus="scsi"/>
Aug 26 13:13:56 user nova-compute[73503]:   <serial>1793b552-b90f-48ac-9a07-2f76960aa716</serial>
Aug 26 13:13:56 user nova-compute[73503]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 13:13:56 user nova-compute[73503]: </disk>
Aug 26 13:13:56 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:13:56 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Successfully detached device sdc from instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f from the persistent domain config.
Aug 26 13:13:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:13:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:13:56 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:56 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:56 user nova-compute[73503]:   <target dev="sdc" bus="scsi"/>
Aug 26 13:13:56 user nova-compute[73503]:   <serial>1793b552-b90f-48ac-9a07-2f76960aa716</serial>
Aug 26 13:13:56 user nova-compute[73503]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 13:13:56 user nova-compute[73503]: </disk>
Aug 26 13:13:56 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693055637.142753, fdc9d288-a75f-452f-b378-c7dcb52d4e6f => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:13:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Successfully detached device sdc from instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f from the live domain config.
Aug 26 13:13:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHxdeJiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992c153-7767-444e-bfb5-0e8299d1bb61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[989c94f7-a59c-4270-a661-35c77d927869]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 (non-flash)
Aug 26 13:13:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31437fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6606b1bd-1645-44f8-98cf-ba1a8a892fe2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c13772-35dc-469b-aeef-ef8485fff4d5]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3103868-2e41-4b90-a632-442c3c15861a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ff4935-9ae5-4c05-9371-82587cfea904]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dcc9d8-5f08-4176-9c88-85be9a9789c0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9285be64-7463-4455-afb5-bfc7eccec26a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260]
Aug 26 13:13:57 user nova-compute[73503]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1793b552-b90f-48ac-9a07-2f76960aa716 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ebfb3a-3439-4aa2-aa17-bbc536462eaa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] <== disconnect_volume: return (312ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:58 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:58 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:13:58 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[247b77b8-27ce-4b8d-87d7-c4e465292b65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:13:58 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d58c02-2119-482c-8d8e-9badb39084f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1] added
Aug 26 13:13:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acd2171-40ee-4caa-9341-716b72031027]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba5fb5c-d579-408e-b315-6665de7eeec0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USymlphT {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USymlphT" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e666af-bbcf-4f35-8067-057938c7273f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USymlphT'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lazy-loading 'flavor' on Instance uuid fdc9d288-a75f-452f-b378-c7dcb52d4e6f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3f6d5-5ff5-4632-b017-1ffb9ecfbbe7]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddda6f-dd50-4c7f-a677-dd5dea981083]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a884f79c-59e3-4034-9754-dc2b166169b5 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac0e64-2a37-48f4-bc11-6f6ec6f83c46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]
Aug 26 13:13:58 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.
Aug 26 13:13:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1a290-46a0-47ba-8616-416edf9ecae3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7834dae5-5aee-409a-913e-970ec843f77c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:13:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f3695-4f87-4941-b6d1-d4ebba0f1c90]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received event network-changed-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Refreshing instance network info cache due to event network-changed-eb4a8bdd-f5de-4bad-a723-f063d68954bd. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] Acquiring lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] Acquired lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Refreshing network info cache for port eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "31572195-0924-47ad-bfe5-01a1266da291" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:58 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lazy-loading 'flavor' on Instance uuid 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "31572195-0924-47ad-bfe5-01a1266da291" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updated VIF entry in instance network info cache for port eb4a8bdd-f5de-4bad-a723-f063d68954bd. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updating instance_info_cache with network_info: [{"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6e2cf098-b90a-4f4f-90ab-4281622c8588 req-9d2909a5-c047-454c-91b5-a0d8ee9e2e97 service nova] Releasing lock "refresh_cache-31572195-0924-47ad-bfe5-01a1266da291" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:13:59 user nova-compute[73503]: INFO nova.compute.manager [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Terminating instance
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "31572195-0924-47ad-bfe5-01a1266da291" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:13:59 user nova-compute[73503]: INFO nova.compute.manager [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Attaching volume 7b20ece9-e4bd-48f4-9f87-832f7d224bb9 to /dev/vdb
Aug 26 13:13:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.utils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1659e3c1-b5c1-42f0-bf41-44910fa357f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf984e97-5ce4-492c-ae84-95a5cff985dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7a4e6a-71b9-412b-81e7-4cdf80aad0bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbabc5c-dbfd-49de-87d6-8d09343bf806]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:13:59 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:13:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b99fed-7894-4f56-baed-071e757a42f5]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.utils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updating existing volume attachment record: 4d75faad-83b4-422a-9288-d6124ba95cc7 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26461353365373233', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461353365373233', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lazy-loading 'flavor' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:13:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:13:59 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:13:59 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:13:59 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:13:59 user nova-compute[73503]:   <serial>052d96e8-29e2-432b-aa13-96b723199bf1</serial>
Aug 26 13:13:59 user nova-compute[73503]: </disk>
Aug 26 13:13:59 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:14:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Instance destroyed successfully.
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.objects.instance [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lazy-loading 'resources' on Instance uuid fdc9d288-a75f-452f-b378-c7dcb52d4e6f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:11:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2058072162',display_name='tempest-AttachSCSIVolumeTestJSON-server-2058072162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2058072162',id=8,image_ref='03e24fa2-1c9f-4014-ad25-11c1b0debd9b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtvMaB0wRIGuPJFFUHekkQtJGQDkqUFAnFh3HP1aXvuwTfFqZf9CcPT+T8ajyzzAFXKNA9Yp1sXmvoAYuNqfJiGcEZEhNl9m3IU3euE5Sey9lguwUyNYCRIQsITrPdXrw==',key_name='tempest-keypair-1206419595',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1808f8a1626f4371a3478142569aab21',ramdisk_id='',reservation_id='r-2ki0buv0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='03e24fa2-1c9f-4014-ad25-11c1b0debd9b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-633590100',owner_user_name='tempest-AttachSCSIVolumeTestJSON-633590100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:11:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c34564d65f640599b8b5c39b2640c91',uuid=fdc9d288-a75f-452f-b378-c7dcb52d4e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Converting VIF {"id": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "address": "fa:16:3e:21:9e:63", "network": {"id": "97fb2203-f973-4078-b1df-e1a7b3bb50e4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-581003550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1808f8a1626f4371a3478142569aab21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3ea59d4-a4", "ovs_interfaceid": "e3ea59d4-a49e-4cda-a3e3-7de5e19c343c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG os_vif [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3ea59d4-a4, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:14:00 user nova-compute[73503]: INFO os_vif [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=e3ea59d4-a49e-4cda-a3e3-7de5e19c343c,network=Network(97fb2203-f973-4078-b1df-e1a7b3bb50e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3ea59d4-a4')
Aug 26 13:14:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Deleting instance files /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f_del
Aug 26 13:14:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Deletion of /opt/stack/data/nova/instances/fdc9d288-a75f-452f-b378-c7dcb52d4e6f_del complete
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] No VIF found with MAC fa:16:3e:5b:4a:f2, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:14:00 user nova-compute[73503]: INFO nova.compute.manager [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0a8c14ea-d86c-410b-994d-fea0aa9b714f tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.550s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-vif-unplugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] No waiting events found dispatching network-vif-unplugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-vif-unplugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] Acquiring lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] No waiting events found dispatching network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:14:00 user nova-compute[73503]: WARNING nova.compute.manager [req-a6ebe771-f4b8-4aaf-9110-c1881d28503d req-fcc9fd96-f0c1-4953-8001-81db76da0998 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received unexpected event network-vif-plugged-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c for instance with vm_state active and task_state deleting.
Aug 26 13:14:01 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:14:01 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Took 0.92 seconds to deallocate network for instance.
Aug 26 13:14:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-348dc157-0f8d-4dec-97f6-ecbce4a05b3f req-c2ebcdff-dcf6-45b2-a7b9-93357aeff884 service nova] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Received event network-vif-deleted-e3ea59d4-a49e-4cda-a3e3-7de5e19c343c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:01 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:14:01 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:14:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:01 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Deleted allocations for instance fdc9d288-a75f-452f-b378-c7dcb52d4e6f
Aug 26 13:14:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb292d94-3ddb-487a-b087-0bcbe8970c85 tempest-AttachSCSIVolumeTestJSON-633590100 tempest-AttachSCSIVolumeTestJSON-633590100-project-member] Lock "fdc9d288-a75f-452f-b378-c7dcb52d4e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG os_brick.utils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c325f1-b785-4216-b294-5e999aa07a77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3971e93-cae0-4cad-b9e7-c54d4d00c313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02350d2-d72e-41fa-ab71-4f6fdc622320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e197fe9e-ae75-4ce9-be3b-46fa248b75c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:14:02 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:14:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d73d0-7244-445d-b5fd-bd671f155dc7]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:14:02 user nova-compute[73503]: DEBUG os_brick.utils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:02 user nova-compute[73503]: INFO nova.compute.manager [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Swapping volume 052d96e8-29e2-432b-aa13-96b723199bf1 for d03fad3f-5b74-483f-97c4-289f7a6315db
Aug 26 13:14:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bflxmuCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:11 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:11 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:11 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1eeea6-3885-4359-be8b-a239b86400cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:14:11 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[411ffcbf-631c-45a9-8900-f4ba5462135e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9] added
Aug 26 13:14:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b96d4-4c43-4f1b-9b09-2e0d51814410]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[985f65b5-43cd-4b55-9137-ed164f7d0c99]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bflxmuCL {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bflxmuCL" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5345222b-66c8-448d-8a25-b1e34274e497]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bflxmuCL'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3980ed4-cf32-4a63-9107-8488820183b5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03ae30-b243-4f3b-9fa5-f07429ec61eb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83108f60-3c02-4c74-ab38-d5421758d34f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260]
Aug 26 13:14:12 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f5bd6-7650-48f7-ac9d-7c111ffd3c85]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d07eacd-7db1-41cb-9be3-4322e68f9ca0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df46cfd-61de-47a4-8c2c-d90012fb8d73]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:14:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bflxmuCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26336326636303837', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336326636303837', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lazy-loading 'flavor' on Instance uuid 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 13:14:13 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:14:13 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:14:13 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:14:13 user nova-compute[73503]:   <serial>7b20ece9-e4bd-48f4-9f87-832f7d224bb9</serial>
Aug 26 13:14:13 user nova-compute[73503]: </disk>
Aug 26 13:14:13 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] No VIF found with MAC fa:16:3e:7e:9f:18, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:14:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b960448-d6a9-45de-aac7-fea3cf598ca5 tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "31572195-0924-47ad-bfe5-01a1266da291" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.540s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] volume_snapshot_create: create_info: {'snapshot_id': 'e0f4658d-88aa-440b-856e-f708c38d7ea7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73503) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] snap xml: <domainsnapshot>
Aug 26 13:14:14 user nova-compute[73503]:   <disks>
Aug 26 13:14:14 user nova-compute[73503]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 26 13:14:14 user nova-compute[73503]:       <source file="/dev/new_file"/>
Aug 26 13:14:14 user nova-compute[73503]:     </disk>
Aug 26 13:14:14 user nova-compute[73503]:     <disk name="vda" snapshot="no"/>
Aug 26 13:14:14 user nova-compute[73503]:   </disks>
Aug 26 13:14:14 user nova-compute[73503]: </domainsnapshot>
Aug 26 13:14:14 user nova-compute[73503]:  {{(pid=73503) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] Lazy-loading 'system_metadata' on Instance uuid 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:14:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-101136a9-d638-4a1a-8077-58317daa1753 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] volume_snapshot_delete: delete_info: {'volume_id': '7b20ece9-e4bd-48f4-9f87-832f7d224bb9'} {{(pid=73503) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [None req-101136a9-d638-4a1a-8077-58317daa1753 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] Traceback (most recent call last):
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     if delete_info['type'] != 'qcow2':
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] KeyError: 'type'
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] 
Aug 26 13:14:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] Traceback (most recent call last):
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     rv = execute(f, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     six.reraise(c, e, tb)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     raise value
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     rv = meth(*args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] 
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] Traceback (most recent call last):
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     self._volume_snapshot_create(context, instance, guest,
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     rv = execute(f, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     six.reraise(c, e, tb)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     raise value
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     rv = meth(*args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [instance: 31572195-0924-47ad-bfe5-01a1266da291] 
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [None req-101136a9-d638-4a1a-8077-58317daa1753 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9f40b29e-75cc-4b34-aa11-6f1927366033)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 13:14:14 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e0f4658d-88aa-440b-856e-f708c38d7ea7 could not be found.
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e0f4658d-88aa-440b-856e-f708c38d7ea7 could not be found. (HTTP 404) (Request-ID: req-31850e67-c850-482d-b01e-81788432b9e0)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e0f4658d-88aa-440b-856e-f708c38d7ea7 could not be found.
Aug 26 13:14:15 user nova-compute[73503]: ERROR nova.virt.libvirt.driver 
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server [None req-101136a9-d638-4a1a-8077-58317daa1753 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] Exception during message handling: KeyError: 'type'
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server 
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server [None req-a3aa89c8-c862-4996-89c8-cd0734dcbff9 tempest-VolumesAssistedSnapshotsTest-1612662673 tempest-VolumesAssistedSnapshotsTest-1612662673-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 13:14:15 user nova-compute[73503]: ERROR oslo_messaging.rpc.server 
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055640.2393577, fdc9d288-a75f-452f-b378-c7dcb52d4e6f => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:14:15 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] VM Stopped (Lifecycle Event)
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkyZsEDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd03fad3f-5b74-483f-97c4-289f7a6315db', 'serial': 'd03fad3f-5b74-483f-97c4-289f7a6315db'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6', 'attached_at': '', 'detached_at': '', 'volume_id': '052d96e8-29e2-432b-aa13-96b723199bf1', 'serial'} {{(pid=73503) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-77e22956-786e-47f9-9262-620e759c9347 None None] [instance: fdc9d288-a75f-452f-b378-c7dcb52d4e6f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkyZsEDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:15 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "31572195-0924-47ad-bfe5-01a1266da291" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: INFO nova.compute.manager [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Detaching volume 7b20ece9-e4bd-48f4-9f87-832f7d224bb9
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4da2bf-1f39-4288-abab-8afac5d09674]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:14:15 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4d1b3f-db96-4a0a-b2fe-b9c4f0ee0c63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db] added
Aug 26 13:14:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef36ca-63cb-4108-bf1c-79a65f19e2a7]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: INFO nova.virt.block_device [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Attempting to driver detach volume 7b20ece9-e4bd-48f4-9f87-832f7d224bb9 from mountpoint /dev/vdb
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38cad64-c300-436f-b2c5-a24f71f951e4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VkyZsEDY {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Attempting to detach device vdb from instance 31572195-0924-47ad-bfe5-01a1266da291 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 13:14:15 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:14:15 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:14:15 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:14:15 user nova-compute[73503]:   <serial>7b20ece9-e4bd-48f4-9f87-832f7d224bb9</serial>
Aug 26 13:14:15 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:14:15 user nova-compute[73503]: </disk>
Aug 26 13:14:15 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Successfully detached device vdb from instance 31572195-0924-47ad-bfe5-01a1266da291 from the persistent domain config.
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31572195-0924-47ad-bfe5-01a1266da291 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 13:14:15 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:14:15 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:14:15 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:14:15 user nova-compute[73503]:   <serial>7b20ece9-e4bd-48f4-9f87-832f7d224bb9</serial>
Aug 26 13:14:15 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:14:15 user nova-compute[73503]: </disk>
Aug 26 13:14:15 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VkyZsEDY" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870b039-ca48-44ea-ad91-6ae3f97313ee]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VkyZsEDY'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[61241aa7-53e7-48c0-be94-1490da404e35]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5bd82e-8fc1-42c5-92b4-11fb8fb9e51d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3a8988-b955-45aa-84fb-893236ce608e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260]
Aug 26 13:14:15 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[217399d2-f8e6-4e5b-8c9d-dccb0657997d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aba175a-e132-4b22-aa0a-979f3227ce65]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884c992-bd2d-46ff-baf2-19964e40f184]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkyZsEDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693055655.9212914, 31572195-0924-47ad-bfe5-01a1266da291 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:14:15 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Successfully detached device vdb from instance 31572195-0924-47ad-bfe5-01a1266da291 from the live domain config.
Aug 26 13:14:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bflxmuCL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23733613866313431', 'path': '/dev/sdg'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613866313431', 'path': '/dev/sdg'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.820s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lazy-loading 'flavor' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7d5078-4eff-498a-9eb2-720d8ff1b0a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbd0f1-3d9d-41cb-86c5-0b9d90a209bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 (non-flash)
Aug 26 13:14:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31c0b1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9'): ({'sdf'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Removing single pathed devices sdf {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d857fa-a8e1-4f42-a684-f71c528b583a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4471619-fde4-4ea2-9a62-2249ba107cd6]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Flushing IO for device /dev/sdf {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f6a64-8421-42e7-90e7-13ef96858b99]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd08d8-d6cb-41ef-865c-68607a1ffe67]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e2a209-7e97-41d3-a6d8-2980ee4403fb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0583586a-59d3-4ebd-b358-7ebfe8aadb60]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260]
Aug 26 13:14:17 user nova-compute[73503]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b20ece9-e4bd-48f4-9f87-832f7d224bb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7fd8c1-f14e-4cfa-be61-6502378bfa41]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] <== disconnect_volume: return (1190ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 325058560 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lazy-loading 'flavor' on Instance uuid 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94b2e9de-50b7-47bc-94f3-ef3a3fa2c98e tempest-VolumesAssistedSnapshotsTest-1770804024 tempest-VolumesAssistedSnapshotsTest-1770804024-project-admin] Lock "31572195-0924-47ad-bfe5-01a1266da291" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.447s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 636485632 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 920649728 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:20 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:14:20 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7260MB free_disk=25.413799285888672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 31572195-0924-47ad-bfe5-01a1266da291 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 14c53f56-9ab5-428c-80c8-c9deb9271ac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:14:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 1070596096 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b979186d-d5e7-4925-ba15-08144bb237d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[17706db4-cb32-4f35-ae36-93f5cce9fc08]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304674280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b69ab7e-e7f3-45e0-9b6e-e08799751829]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d084180a-74ec-465f-90d2-c995afb36c62]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605c637-996f-4746-b3ad-07720727af10]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf2db5-8f5e-4ad7-9c6a-809d1ec32ab5]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf487c6-31dd-4721-9cc0-11f53ad9b5fa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe94bd-8cfa-476d-8465-afe66c4b8d9a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]
Aug 26 13:14:21 user nova-compute[73503]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc98bd24-c14f-4951-8766-e09ba4cc0b3f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] <== disconnect_volume: return (325ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkyZsEDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd03fad3f-5b74-483f-97c4-289f7a6315db', 'serial'} {{(pid=73503) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 13:14:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] swap_volume: removing Cinder connection for volume 052d96e8-29e2-432b-aa13-96b723199bf1 {{(pid=73503) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 13:14:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] swap_volume: Updating volume 052d96e8-29e2-432b-aa13-96b723199bf1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "VkyZsEDY", "auth_password": "WdJf2bvxQDGReF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "d03fad3f-5b74-483f-97c4-289f7a6315db"}, "status": "reserved", "instance": "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6", "attached_at": "", "detached_at": "", "volume_id": "d03fad3f-5b74-483f-97c4-289f7a6315db", "serial": "d03fad3f-5b74-483f-97c4-289f7a6315db"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd03fad3f-5b74-483f-97c4-289f7a6315db', 'no_device': None, 'attachment_id': 'b2445ca4-9ba6-44a1-b489-56faa1184d8e'} {{(pid=73503) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 13:14:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d5bcb4a6-bc25-43d9-8d4e-f1d80d00e4a3 tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.443s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG os_brick.utils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1cc060-6824-4e6d-bca1-7b293872fd22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afe1191-a7cc-42f4-98da-9b8f4debe0ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b2332-81dd-440a-b64d-cdf3516e159b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d38bf-f628-41b5-ba58-c084143e9bee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:14:24 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:14:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daf47f6-1c88-4500-a5c3-4273ffc7a9d4]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:14:24 user nova-compute[73503]: DEBUG os_brick.utils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:24 user nova-compute[73503]: INFO nova.compute.manager [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Swapping volume d03fad3f-5b74-483f-97c4-289f7a6315db for 052d96e8-29e2-432b-aa13-96b723199bf1
Aug 26 13:14:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:14:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6', 'attached_at': '', 'detached_at': '', 'volume_id': '052d96e8-29e2-432b-aa13-96b723199bf1', 'serial': '052d96e8-29e2-432b-aa13-96b723199bf1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkyZsEDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'd03fad3f-5b74-483f-97c4-289f7a6315db'}, 'status': 'reserved', 'instance': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd03fad3f-5b74-483f-97c4-289f7a6315db', 'serial'} {{(pid=73503) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:36 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:36 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:36 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d65e206-03cb-46e2-994a-de333de745fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:14:36 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa8aa1f-7916-4601-abb0-63697149dc61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1] added
Aug 26 13:14:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a9073-4f8a-41fb-84cb-1789da50dae3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e68e8f-beaf-4f9b-91ba-5e5662d10f6c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USymlphT {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USymlphT" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e109ac5f-0b33-4376-9b7a-19069384775d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USymlphT'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe85b88-69bb-4935-96a2-f4632c56ce84]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb8906-63c8-41dc-bebd-24e4f4c70f01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a78109-e1e1-428b-8eb2-79bea6ad945a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]
Aug 26 13:14:36 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cf2bd2-5237-47f2-8b7a-414c03671392]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fed9a30-77a8-4019-a58f-f299250d4e6e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf97ce7-a71b-4d70-93dc-91cf90f853e7]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:14:37 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:14:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:14:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26461353365373233', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461353365373233', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:14:37 user nova-compute[73503]: DEBUG nova.objects.instance [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lazy-loading 'flavor' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 263192576 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 367001600 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 529530880 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 842006528 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 967835648 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VkyZsEDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'd03fad3f-5b74-483f-97c4-289f7a6315db'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef87f88-06de-4ad9-ad3f-e5657a6c11e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa14cc56-978d-4d82-a7da-86efee5185dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304523250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db'): ({'sdg'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Removing single pathed devices sdg {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398eaa3-36df-4104-add4-af74e54fd032]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb30e1-8956-4621-979e-30fc1618db54]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Flushing IO for device /dev/sdg {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcce331-193a-4220-abd5-79fbdfb0919d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8771d-3ed9-4d44-b002-fea25b9efde1]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] SCSI volumes sdg have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc7ae76-e11a-4a47-8990-186b4f1cba7c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fb3303-9184-4cd3-8fb3-19b09b4391ef]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260]
Aug 26 13:14:42 user nova-compute[73503]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d03fad3f-5b74-483f-97c4-289f7a6315db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7e2103-9af3-4262-aac1-8b59b72b25bb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] <== disconnect_volume: return (300ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7bf712b0-6ee5-4311-a7e2-d3461af1a8c6', 'attached_at': '', 'detached_at': '', 'volume_id': '052d96e8-29e2-432b-aa13-96b723199bf1', 'serial'} {{(pid=73503) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] swap_volume: removing Cinder connection for volume d03fad3f-5b74-483f-97c4-289f7a6315db {{(pid=73503) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:14:42 user nova-compute[73503]: INFO nova.compute.claims [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Claim successful on node user
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:14:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.policy [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e355237acb74d80b008f41672cea5d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46148f4972634a4fbd1987020a7a5d85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:14:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Creating image(s)
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "/opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "/opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.213s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk 1073741824" returned: 0 in 0.096s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Successfully created port: b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Cannot resize image /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Ensure instance console log exists: /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Successfully updated port: b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "refresh_cache-9e6a741c-7b48-43f7-b8c3-344514c48c94" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquired lock "refresh_cache-9e6a741c-7b48-43f7-b8c3-344514c48c94" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-changed-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Refreshing instance network info cache due to event network-changed-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] Acquiring lock "refresh_cache-9e6a741c-7b48-43f7-b8c3-344514c48c94" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Updating instance_info_cache with network_info: [{"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Releasing lock "refresh_cache-9e6a741c-7b48-43f7-b8c3-344514c48c94" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Instance network_info: |[{"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] Acquired lock "refresh_cache-9e6a741c-7b48-43f7-b8c3-344514c48c94" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Refreshing network info cache for port b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Start _get_guest_xml network_info=[{"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:14:45 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:14:45 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2018137376',display_name='tempest-VolumesAdminNegativeTest-server-2018137376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2018137376',id=13,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46148f4972634a4fbd1987020a7a5d85',ramdisk_id='',reservation_id='r-g41mwm6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-762845259',owner_user_name='tempest-VolumesAdminNegativeTest-762845259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:14:43Z,user_data=None,user_id='4e355237acb74d80b008f41672cea5d2',uuid=9e6a741c-7b48-43f7-b8c3-344514c48c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converting VIF {"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.objects.instance [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e6a741c-7b48-43f7-b8c3-344514c48c94 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:14:45 user nova-compute[73503]:   <uuid>9e6a741c-7b48-43f7-b8c3-344514c48c94</uuid>
Aug 26 13:14:45 user nova-compute[73503]:   <name>instance-0000000d</name>
Aug 26 13:14:45 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:14:45 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:14:45 user nova-compute[73503]:   <metadata>
Aug 26 13:14:45 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:14:45 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:14:45 user nova-compute[73503]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2018137376</nova:name>
Aug 26 13:14:45 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:14:45</nova:creationTime>
Aug 26 13:14:45 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:14:45 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:14:45 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:14:45 user nova-compute[73503]:       <nova:owner>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:user uuid="4e355237acb74d80b008f41672cea5d2">tempest-VolumesAdminNegativeTest-762845259-project-member</nova:user>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:project uuid="46148f4972634a4fbd1987020a7a5d85">tempest-VolumesAdminNegativeTest-762845259</nova:project>
Aug 26 13:14:45 user nova-compute[73503]:       </nova:owner>
Aug 26 13:14:45 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:14:45 user nova-compute[73503]:       <nova:ports>
Aug 26 13:14:45 user nova-compute[73503]:         <nova:port uuid="b778ea7e-c8bd-4eb8-af66-a6b49373cf4a">
Aug 26 13:14:45 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:14:45 user nova-compute[73503]:         </nova:port>
Aug 26 13:14:45 user nova-compute[73503]:       </nova:ports>
Aug 26 13:14:45 user nova-compute[73503]:     </nova:instance>
Aug 26 13:14:45 user nova-compute[73503]:   </metadata>
Aug 26 13:14:45 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:14:45 user nova-compute[73503]:     <system>
Aug 26 13:14:45 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:14:45 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:14:45 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:14:45 user nova-compute[73503]:       <entry name="serial">9e6a741c-7b48-43f7-b8c3-344514c48c94</entry>
Aug 26 13:14:45 user nova-compute[73503]:       <entry name="uuid">9e6a741c-7b48-43f7-b8c3-344514c48c94</entry>
Aug 26 13:14:45 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:14:45 user nova-compute[73503]:     </system>
Aug 26 13:14:45 user nova-compute[73503]:   </sysinfo>
Aug 26 13:14:45 user nova-compute[73503]:   <os>
Aug 26 13:14:45 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:14:45 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:14:45 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:14:45 user nova-compute[73503]:   </os>
Aug 26 13:14:45 user nova-compute[73503]:   <features>
Aug 26 13:14:45 user nova-compute[73503]:     <acpi/>
Aug 26 13:14:45 user nova-compute[73503]:     <apic/>
Aug 26 13:14:45 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:14:45 user nova-compute[73503]:   </features>
Aug 26 13:14:45 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:14:45 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:14:45 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:14:45 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:14:45 user nova-compute[73503]:   </clock>
Aug 26 13:14:45 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:14:45 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:14:45 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:14:45 user nova-compute[73503]:   </cpu>
Aug 26 13:14:45 user nova-compute[73503]:   <devices>
Aug 26 13:14:45 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:14:45 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:14:45 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk"/>
Aug 26 13:14:45 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:14:45 user nova-compute[73503]:     </disk>
Aug 26 13:14:45 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:14:45 user nova-compute[73503]:       <mac address="fa:16:3e:11:5f:fa"/>
Aug 26 13:14:45 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:14:45 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:14:45 user nova-compute[73503]:       <target dev="tapb778ea7e-c8"/>
Aug 26 13:14:45 user nova-compute[73503]:     </interface>
Aug 26 13:14:45 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:14:45 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/console.log" append="off"/>
Aug 26 13:14:45 user nova-compute[73503]:     </serial>
Aug 26 13:14:45 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:14:45 user nova-compute[73503]:     <video>
Aug 26 13:14:45 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:14:45 user nova-compute[73503]:     </video>
Aug 26 13:14:45 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:14:45 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:14:45 user nova-compute[73503]:     </rng>
Aug 26 13:14:45 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:14:45 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:14:45 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:14:45 user nova-compute[73503]:     </memballoon>
Aug 26 13:14:45 user nova-compute[73503]:   </devices>
Aug 26 13:14:45 user nova-compute[73503]: </domain>
Aug 26 13:14:45 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2018137376',display_name='tempest-VolumesAdminNegativeTest-server-2018137376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2018137376',id=13,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46148f4972634a4fbd1987020a7a5d85',ramdisk_id='',reservation_id='r-g41mwm6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-762845259',owner_user_name='tempest-VolumesAdminNegativeTest-762845259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:14:43Z,user_data=None,user_id='4e355237acb74d80b008f41672cea5d2',uuid=9e6a741c-7b48-43f7-b8c3-344514c48c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converting VIF {"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG os_vif [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb778ea7e-c8, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb778ea7e-c8, col_values=(('external_ids', {'iface-id': 'b778ea7e-c8bd-4eb8-af66-a6b49373cf4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:5f:fa', 'vm-uuid': '9e6a741c-7b48-43f7-b8c3-344514c48c94'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:45 user nova-compute[73503]: INFO os_vif [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8')
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:14:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] No VIF found with MAC fa:16:3e:11:5f:fa, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:14:46 user nova-compute[73503]: DEBUG nova.network.neutron [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Updated VIF entry in instance network info cache for port b778ea7e-c8bd-4eb8-af66-a6b49373cf4a. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:14:46 user nova-compute[73503]: DEBUG nova.network.neutron [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Updating instance_info_cache with network_info: [{"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:14:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4aa49fe1-8ea9-4af0-b263-27f3cbd9dfff req-018feb56-2bce-4f7e-ba54-44b4718cabf4 service nova] Releasing lock "refresh_cache-9e6a741c-7b48-43f7-b8c3-344514c48c94" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e1f28ce-de98-4597-a862-7ce944e6c4d3 req-d79b1368-f174-4952-9f86-8feafa184480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e1f28ce-de98-4597-a862-7ce944e6c4d3 req-d79b1368-f174-4952-9f86-8feafa184480 service nova] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e1f28ce-de98-4597-a862-7ce944e6c4d3 req-d79b1368-f174-4952-9f86-8feafa184480 service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1e1f28ce-de98-4597-a862-7ce944e6c4d3 req-d79b1368-f174-4952-9f86-8feafa184480 service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-1e1f28ce-de98-4597-a862-7ce944e6c4d3 req-d79b1368-f174-4952-9f86-8feafa184480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] No waiting events found dispatching network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:14:47 user nova-compute[73503]: WARNING nova.compute.manager [req-1e1f28ce-de98-4597-a862-7ce944e6c4d3 req-d79b1368-f174-4952-9f86-8feafa184480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received unexpected event network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a for instance with vm_state building and task_state spawning.
Aug 26 13:14:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] swap_volume: Updating volume d03fad3f-5b74-483f-97c4-289f7a6315db BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "USymlphT", "auth_password": "IpCuh8RWw4OfMJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "052d96e8-29e2-432b-aa13-96b723199bf1"}, "status": "reserved", "instance": "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6", "attached_at": "", "detached_at": "", "volume_id": "052d96e8-29e2-432b-aa13-96b723199bf1", "serial": "052d96e8-29e2-432b-aa13-96b723199bf1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '052d96e8-29e2-432b-aa13-96b723199bf1', 'no_device': None, 'attachment_id': '814bf283-063e-49fa-934c-aee77f778db1'} {{(pid=73503) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-aecebe0f-d4a7-4af6-af97-fa0306a65d4a tempest-TestVolumeSwap-725288637 tempest-TestVolumeSwap-725288637-project-admin] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 25.037s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055689.4731503, 9e6a741c-7b48-43f7-b8c3-344514c48c94 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] VM Resumed (Lifecycle Event)
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Instance spawned successfully.
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055689.4737148, 9e6a741c-7b48-43f7-b8c3-344514c48c94 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] VM Started (Lifecycle Event)
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-bd0e5c98-1a2b-455c-8286-952492a9babd req-378304ec-2712-4afa-ba48-87e94644731d service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bd0e5c98-1a2b-455c-8286-952492a9babd req-378304ec-2712-4afa-ba48-87e94644731d service nova] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bd0e5c98-1a2b-455c-8286-952492a9babd req-378304ec-2712-4afa-ba48-87e94644731d service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bd0e5c98-1a2b-455c-8286-952492a9babd req-378304ec-2712-4afa-ba48-87e94644731d service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-bd0e5c98-1a2b-455c-8286-952492a9babd req-378304ec-2712-4afa-ba48-87e94644731d service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] No waiting events found dispatching network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:14:49 user nova-compute[73503]: WARNING nova.compute.manager [req-bd0e5c98-1a2b-455c-8286-952492a9babd req-378304ec-2712-4afa-ba48-87e94644731d service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received unexpected event network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a for instance with vm_state building and task_state spawning.
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Took 6.89 seconds to build instance.
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-add8436c-4a69-4b08-9574-3fe7ce284643 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:49 user nova-compute[73503]: INFO nova.compute.manager [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Terminating instance
Aug 26 13:14:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8656fef-1294-4f65-9ee8-b7575742e5f0 req-3c63e0d5-c7dd-411b-8cdb-c0c57cc43d3f service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-vif-unplugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8656fef-1294-4f65-9ee8-b7575742e5f0 req-3c63e0d5-c7dd-411b-8cdb-c0c57cc43d3f service nova] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8656fef-1294-4f65-9ee8-b7575742e5f0 req-3c63e0d5-c7dd-411b-8cdb-c0c57cc43d3f service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8656fef-1294-4f65-9ee8-b7575742e5f0 req-3c63e0d5-c7dd-411b-8cdb-c0c57cc43d3f service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8656fef-1294-4f65-9ee8-b7575742e5f0 req-3c63e0d5-c7dd-411b-8cdb-c0c57cc43d3f service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] No waiting events found dispatching network-vif-unplugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8656fef-1294-4f65-9ee8-b7575742e5f0 req-3c63e0d5-c7dd-411b-8cdb-c0c57cc43d3f service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-vif-unplugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:14:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Instance destroyed successfully.
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lazy-loading 'resources' on Instance uuid 14c53f56-9ab5-428c-80c8-c9deb9271ac6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:12:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1054634393',display_name='tempest-ServersNegativeTestJSON-server-1054634393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1054634393',id=12,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='933ef3f76b494bbaabf6511c70fc312c',ramdisk_id='',reservation_id='r-5huy08yz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-410549196',owner_user_name='tempest-ServersNegativeTestJSON-410549196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:08Z,user_data=None,user_id='e23ee63bc296443fbe8224f94cff507a',uuid=14c53f56-9ab5-428c-80c8-c9deb9271ac6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converting VIF {"id": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "address": "fa:16:3e:d4:34:13", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8661d1f3-2e", "ovs_interfaceid": "8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG os_vif [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8661d1f3-2e, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:14:50 user nova-compute[73503]: INFO os_vif [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:34:13,bridge_name='br-int',has_traffic_filtering=True,id=8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8661d1f3-2e')
Aug 26 13:14:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Deleting instance files /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6_del
Aug 26 13:14:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Deletion of /opt/stack/data/nova/instances/14c53f56-9ab5-428c-80c8-c9deb9271ac6_del complete
Aug 26 13:14:50 user nova-compute[73503]: INFO nova.compute.manager [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 13:14:50 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:14:50 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:51 user nova-compute[73503]: INFO nova.compute.manager [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Detaching volume 052d96e8-29e2-432b-aa13-96b723199bf1
Aug 26 13:14:51 user nova-compute[73503]: INFO nova.virt.block_device [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Attempting to driver detach volume 052d96e8-29e2-432b-aa13-96b723199bf1 from mountpoint /dev/vdb
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Attempting to detach device vdb from instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:14:51 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:14:51 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:14:51 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:14:51 user nova-compute[73503]:   <serial>052d96e8-29e2-432b-aa13-96b723199bf1</serial>
Aug 26 13:14:51 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:14:51 user nova-compute[73503]: </disk>
Aug 26 13:14:51 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:14:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Successfully detached device vdb from instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 from the persistent domain config.
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:14:51 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:14:51 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:14:51 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:14:51 user nova-compute[73503]:   <serial>052d96e8-29e2-432b-aa13-96b723199bf1</serial>
Aug 26 13:14:51 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:14:51 user nova-compute[73503]: </disk>
Aug 26 13:14:51 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:14:51 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Took 0.70 seconds to deallocate network for instance.
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693055691.6729076, 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:14:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Successfully detached device vdb from instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 from the live domain config.
Aug 26 13:14:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USymlphT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '052d96e8-29e2-432b-aa13-96b723199bf1'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:14:51 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd71b5a-dc96-475e-9b55-efc929e5e61c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9a9be9-9779-40a0-bd39-9481364ffdea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:14:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30459f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[95214d2a-9c8d-4dc6-9a4a-0f4cfb76ac53]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5935ccd6-b0d1-41aa-addd-8de4a8bcdaf7]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08553c9f-cc1e-4683-9fe7-b2231012e1b4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6b0ece-9f95-4f1b-b036-98901d268c5d]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aa60d7-cda6-4a58-804c-6253d0428993]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[399629d2-f981-452d-b41a-40b95693569e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260]
Aug 26 13:14:52 user nova-compute[73503]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1, portal: 172.16.0.220,3260] successful.
Aug 26 13:14:52 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:052d96e8-29e2-432b-aa13-96b723199bf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b73e8c-ecce-42c0-91b0-0b074f356068]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] <== disconnect_volume: return (357ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:52 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Deleted allocations for instance 14c53f56-9ab5-428c-80c8-c9deb9271ac6
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d94823f-2614-47c0-a35d-523f0463a1af tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] Acquiring lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] Lock "14c53f56-9ab5-428c-80c8-c9deb9271ac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] No waiting events found dispatching network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:14:52 user nova-compute[73503]: WARNING nova.compute.manager [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received unexpected event network-vif-plugged-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 for instance with vm_state deleted and task_state None.
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-0eddcf9b-bfad-4889-b404-109f76fd4008 req-aa58a799-4787-4d06-ba7e-8b09959c8f40 service nova] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Received event network-vif-deleted-8661d1f3-2e3b-4e5a-ba35-f6f5ebc5b1e3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lazy-loading 'flavor' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:14:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e0444c7e-55c1-4bcc-a9fb-382985657859 tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.957s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:14:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:05 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055690.7363071, 14c53f56-9ab5-428c-80c8-c9deb9271ac6 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:05 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] VM Stopped (Lifecycle Event)
Aug 26 13:15:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-87fa9e22-442a-45a7-a8e6-62663dcdd5c0 None None] [instance: 14c53f56-9ab5-428c-80c8-c9deb9271ac6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:15:07 user nova-compute[73503]: INFO nova.compute.claims [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Claim successful on node user
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:15:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.policy [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a9851519cfc49c388894f0884261586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8967f8280045e8b45d9298bda30914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:15:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Creating image(s)
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.257s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk 1073741824" returned: 0 in 0.086s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Successfully created port: 5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Cannot resize image /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Ensure instance console log exists: /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:09 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'flavor' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Successfully updated port: 5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquired lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-changed-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Refreshing instance network info cache due to event network-changed-5947525d-216d-4665-9d3c-b7c3deadfb70. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] Acquiring lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:10 user nova-compute[73503]: INFO nova.compute.manager [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Attaching volume 957d26ff-ff9f-404f-bd86-542b3fab7f84 to /dev/vdb
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e27bd4-ec68-478e-95bc-e159bc73daff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f742c1-55a7-4acb-9d9f-a452adf27149]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d122eaa-869a-4989-a561-d8a53c83f1d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee4a38-0fe2-4b83-8e05-bc28210dc984]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:15:10 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88f203-9ea8-4a0b-9d23-f132e6e9ab57]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating existing volume attachment record: 61f751eb-5106-4812-b062-5d820ecd50ab {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating instance_info_cache with network_info: [{"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Releasing lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance network_info: |[{"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] Acquired lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Refreshing network info cache for port 5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Start _get_guest_xml network_info=[{"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:15:10 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:10 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1683915817',display_name='tempest-tempest.common.compute-instance-1683915817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1683915817',id=14,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FicSYtb+XZMerD16xYzO8q+U3g8rcG5d5MFbKomScizcC0+Fw0fIAVHBROQZJpRPR1Ifo9emWEM9YNTyE+juaAPyhTubC/2jYPI8N8OQIO3i32kDqa2jmMSSw5sG/yA==',key_name='tempest-keypair-1153890614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-l71x2txa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ab4f580b-7abb-45b1-84fd-79957526124a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'pci_devices' on Instance uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:15:10 user nova-compute[73503]:   <uuid>ab4f580b-7abb-45b1-84fd-79957526124a</uuid>
Aug 26 13:15:10 user nova-compute[73503]:   <name>instance-0000000e</name>
Aug 26 13:15:10 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:15:10 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:15:10 user nova-compute[73503]:   <metadata>
Aug 26 13:15:10 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:15:10 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:15:10 user nova-compute[73503]:       <nova:name>tempest-tempest.common.compute-instance-1683915817</nova:name>
Aug 26 13:15:10 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:15:10</nova:creationTime>
Aug 26 13:15:10 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:15:10 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:15:10 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:15:10 user nova-compute[73503]:       <nova:owner>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:user uuid="2a9851519cfc49c388894f0884261586">tempest-ServerActionsTestOtherA-856596274-project-member</nova:user>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:project uuid="9f8967f8280045e8b45d9298bda30914">tempest-ServerActionsTestOtherA-856596274</nova:project>
Aug 26 13:15:10 user nova-compute[73503]:       </nova:owner>
Aug 26 13:15:10 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:15:10 user nova-compute[73503]:       <nova:ports>
Aug 26 13:15:10 user nova-compute[73503]:         <nova:port uuid="5947525d-216d-4665-9d3c-b7c3deadfb70">
Aug 26 13:15:10 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:15:10 user nova-compute[73503]:         </nova:port>
Aug 26 13:15:10 user nova-compute[73503]:       </nova:ports>
Aug 26 13:15:10 user nova-compute[73503]:     </nova:instance>
Aug 26 13:15:10 user nova-compute[73503]:   </metadata>
Aug 26 13:15:10 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:15:10 user nova-compute[73503]:     <system>
Aug 26 13:15:10 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:15:10 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:15:10 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:15:10 user nova-compute[73503]:       <entry name="serial">ab4f580b-7abb-45b1-84fd-79957526124a</entry>
Aug 26 13:15:10 user nova-compute[73503]:       <entry name="uuid">ab4f580b-7abb-45b1-84fd-79957526124a</entry>
Aug 26 13:15:10 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:15:10 user nova-compute[73503]:     </system>
Aug 26 13:15:10 user nova-compute[73503]:   </sysinfo>
Aug 26 13:15:10 user nova-compute[73503]:   <os>
Aug 26 13:15:10 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:15:10 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:15:10 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:15:10 user nova-compute[73503]:   </os>
Aug 26 13:15:10 user nova-compute[73503]:   <features>
Aug 26 13:15:10 user nova-compute[73503]:     <acpi/>
Aug 26 13:15:10 user nova-compute[73503]:     <apic/>
Aug 26 13:15:10 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:15:10 user nova-compute[73503]:   </features>
Aug 26 13:15:10 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:15:10 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:15:10 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:15:10 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:15:10 user nova-compute[73503]:   </clock>
Aug 26 13:15:10 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:15:10 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:15:10 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:15:10 user nova-compute[73503]:   </cpu>
Aug 26 13:15:10 user nova-compute[73503]:   <devices>
Aug 26 13:15:10 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:15:10 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:15:10 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk"/>
Aug 26 13:15:10 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:15:10 user nova-compute[73503]:     </disk>
Aug 26 13:15:10 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:15:10 user nova-compute[73503]:       <mac address="fa:16:3e:cc:2f:32"/>
Aug 26 13:15:10 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:15:10 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:15:10 user nova-compute[73503]:       <target dev="tap5947525d-21"/>
Aug 26 13:15:10 user nova-compute[73503]:     </interface>
Aug 26 13:15:10 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:15:10 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/console.log" append="off"/>
Aug 26 13:15:10 user nova-compute[73503]:     </serial>
Aug 26 13:15:10 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:15:10 user nova-compute[73503]:     <video>
Aug 26 13:15:10 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:15:10 user nova-compute[73503]:     </video>
Aug 26 13:15:10 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:15:10 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:15:10 user nova-compute[73503]:     </rng>
Aug 26 13:15:10 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:15:10 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:15:10 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:15:10 user nova-compute[73503]:     </memballoon>
Aug 26 13:15:10 user nova-compute[73503]:   </devices>
Aug 26 13:15:10 user nova-compute[73503]: </domain>
Aug 26 13:15:10 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1683915817',display_name='tempest-tempest.common.compute-instance-1683915817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1683915817',id=14,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FicSYtb+XZMerD16xYzO8q+U3g8rcG5d5MFbKomScizcC0+Fw0fIAVHBROQZJpRPR1Ifo9emWEM9YNTyE+juaAPyhTubC/2jYPI8N8OQIO3i32kDqa2jmMSSw5sG/yA==',key_name='tempest-keypair-1153890614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-l71x2txa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ab4f580b-7abb-45b1-84fd-79957526124a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG os_vif [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5947525d-21, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5947525d-21, col_values=(('external_ids', {'iface-id': '5947525d-216d-4665-9d3c-b7c3deadfb70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:2f:32', 'vm-uuid': 'ab4f580b-7abb-45b1-84fd-79957526124a'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:10 user nova-compute[73503]: INFO os_vif [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21')
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No VIF found with MAC fa:16:3e:cc:2f:32, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:15:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updated VIF entry in instance network info cache for port 5947525d-216d-4665-9d3c-b7c3deadfb70. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:15:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating instance_info_cache with network_info: [{"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52ada12f-07bd-4de8-a25d-f54376ca28ee req-0d1771da-553e-4bac-b46c-28a1ba34f918 service nova] Releasing lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-ff5a4c58-0c4e-4ba8-8596-730395d6c224 req-677339e3-6237-4ba6-9ebb-c36864cadd3d service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ff5a4c58-0c4e-4ba8-8596-730395d6c224 req-677339e3-6237-4ba6-9ebb-c36864cadd3d service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ff5a4c58-0c4e-4ba8-8596-730395d6c224 req-677339e3-6237-4ba6-9ebb-c36864cadd3d service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ff5a4c58-0c4e-4ba8-8596-730395d6c224 req-677339e3-6237-4ba6-9ebb-c36864cadd3d service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-ff5a4c58-0c4e-4ba8-8596-730395d6c224 req-677339e3-6237-4ba6-9ebb-c36864cadd3d service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:12 user nova-compute[73503]: WARNING nova.compute.manager [req-ff5a4c58-0c4e-4ba8-8596-730395d6c224 req-677339e3-6237-4ba6-9ebb-c36864cadd3d service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state building and task_state spawning.
Aug 26 13:15:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:13 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updating instance_info_cache with network_info: [{"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-950df9cd-10d7-45cb-9714-9ee01f508acd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bd47548-ec41-4c6f-981f-170182eb2b01 req-220a2f18-8733-4424-a397-12ccf43ed972 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bd47548-ec41-4c6f-981f-170182eb2b01 req-220a2f18-8733-4424-a397-12ccf43ed972 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bd47548-ec41-4c6f-981f-170182eb2b01 req-220a2f18-8733-4424-a397-12ccf43ed972 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bd47548-ec41-4c6f-981f-170182eb2b01 req-220a2f18-8733-4424-a397-12ccf43ed972 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bd47548-ec41-4c6f-981f-170182eb2b01 req-220a2f18-8733-4424-a397-12ccf43ed972 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:14 user nova-compute[73503]: WARNING nova.compute.manager [req-9bd47548-ec41-4c6f-981f-170182eb2b01 req-220a2f18-8733-4424-a397-12ccf43ed972 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state building and task_state spawning.
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055714.9371922, ab4f580b-7abb-45b1-84fd-79957526124a => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:14 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] VM Resumed (Lifecycle Event)
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:15:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance spawned successfully.
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:15:15 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055714.9392557, ab4f580b-7abb-45b1-84fd-79957526124a => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:15 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] VM Started (Lifecycle Event)
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:15 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:15:15 user nova-compute[73503]: INFO nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Took 7.48 seconds to spawn the instance on the hypervisor.
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:15 user nova-compute[73503]: INFO nova.compute.manager [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Took 8.35 seconds to build instance.
Aug 26 13:15:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-50768795-fa2f-4926-8af3-6bd1896fd847 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.501s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:15:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "31572195-0924-47ad-bfe5-01a1266da291" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "31572195-0924-47ad-bfe5-01a1266da291-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "31572195-0924-47ad-bfe5-01a1266da291-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "31572195-0924-47ad-bfe5-01a1266da291-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:16 user nova-compute[73503]: INFO nova.compute.manager [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Terminating instance
Aug 26 13:15:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.300s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Instance destroyed successfully.
Aug 26 13:15:17 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lazy-loading 'resources' on Instance uuid 31572195-0924-47ad-bfe5-01a1266da291 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-852605157',display_name='tempest-VolumesAssistedSnapshotsTest-server-852605157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-852605157',id=10,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODandm9RHjs3k90mW+zeGfbR0TM0/H2do+pjQk9Rpi0cEUm0wuPMnIy2ESi5VRFjc6JiyaP2DNeslUte1TGtGodj7fcsygyBVIA7xt95EU08B4ojcO7bNYh4MtA93v5VQ==',key_name='tempest-keypair-632134712',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:12:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a05138cd9ea425581df7e6169fea3c5',ramdisk_id='',reservation_id='r-fd7df3po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-146844530',owner_user_name='tempest-VolumesAssistedSnapshotsTest-146844530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:12:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='400cf575a3734f73a1f3dfa93e03e243',uuid=31572195-0924-47ad-bfe5-01a1266da291,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Converting VIF {"id": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "address": "fa:16:3e:7e:9f:18", "network": {"id": "e5970630-8779-4365-9199-d0ef2c703a83", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1715277555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a05138cd9ea425581df7e6169fea3c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb4a8bdd-f5", "ovs_interfaceid": "eb4a8bdd-f5de-4bad-a723-f063d68954bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG os_vif [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb4a8bdd-f5, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:17 user nova-compute[73503]: INFO os_vif [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:9f:18,bridge_name='br-int',has_traffic_filtering=True,id=eb4a8bdd-f5de-4bad-a723-f063d68954bd,network=Network(e5970630-8779-4365-9199-d0ef2c703a83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb4a8bdd-f5')
Aug 26 13:15:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Deleting instance files /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291_del
Aug 26 13:15:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Deletion of /opt/stack/data/nova/instances/31572195-0924-47ad-bfe5-01a1266da291_del complete
Aug 26 13:15:17 user nova-compute[73503]: INFO nova.compute.manager [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:15:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:19 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Took 1.64 seconds to deallocate network for instance.
Aug 26 13:15:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-11f83d37-5c91-40bd-8fb0-406d915fc01e req-afed4e81-d97c-49da-9263-f96c2e494389 service nova] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Received event network-vif-deleted-eb4a8bdd-f5de-4bad-a723-f063d68954bd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.700s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:20 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Deleted allocations for instance 31572195-0924-47ad-bfe5-01a1266da291
Aug 26 13:15:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a82569b9-8962-4efe-97a6-a1bda2192570 tempest-VolumesAssistedSnapshotsTest-146844530 tempest-VolumesAssistedSnapshotsTest-146844530-project-member] Lock "31572195-0924-47ad-bfe5-01a1266da291" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.604s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:21 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:21 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7376MB free_disk=25.429527282714844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9e6a741c-7b48-43f7-b8c3-344514c48c94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ab4f580b-7abb-45b1-84fd-79957526124a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:15:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:15:22 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:15:22 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:15:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:15:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:24 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[07794206-0a85-42d2-b8ba-13520b9531ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:15:24 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8e4fb6-0a73-436f-9779-f6e3ddb75230]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84] added
Aug 26 13:15:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[490dd5b5-d090-4db0-abe7-b564af29de14]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[780a5c62-0801-4a9e-a9ca-f14cde73c3c5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhbSkqZu {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhbSkqZu" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9bebe4-601a-4528-b62e-018ba8d3373e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhbSkqZu'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d65fa4-9808-4e2d-8685-e6d9ea661a50]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910d8f9-018d-43e1-8d2e-1def0895fab0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313a7801-8736-4374-b197-510d8517d1af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313a7801-8736-4374-b197-510d8517d1af (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313a7801-8736-4374-b197-510d8517d1af (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26a332-de17-49af-8532-0e2efadf5edb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]
Aug 26 13:15:24 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.
Aug 26 13:15:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c729c7-bf65-4299-a18b-d371b46ed9e5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5f772-08d3-407e-bad6-bf2c9a56d9eb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313a7801-8736-4374-b197-510d8517d1af (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313a7801-8736-4374-b197-510d8517d1af (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313a7801-8736-4374-b197-510d8517d1af (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae9a54a-2af8-412d-9125-daadf72da9e3]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:15:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:15:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23035656662323061', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035656662323061', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:15:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'flavor' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:15:25 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:15:25 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:15:25 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:15:25 user nova-compute[73503]:   <serial>957d26ff-ff9f-404f-bd86-542b3fab7f84</serial>
Aug 26 13:15:25 user nova-compute[73503]: </disk>
Aug 26 13:15:25 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:15:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No VIF found with MAC fa:16:3e:c5:4c:46, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:15:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58b94dd-94ab-41ab-ae2f-2ff9258bb472 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.570s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-changed-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing instance network info cache due to event network-changed-a9d5a677-8385-48ba-8d33-3383fdf4f687. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] Acquiring lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] Acquired lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG nova.network.neutron [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Refreshing network info cache for port a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG nova.network.neutron [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updated VIF entry in instance network info cache for port a9d5a677-8385-48ba-8d33-3383fdf4f687. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG nova.network.neutron [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6629a360-8617-4cd6-bd97-f6f9b6b868e5 req-8f9376bf-0760-4059-8ca1-6e314c863fcd service nova] Releasing lock "refresh_cache-64455011-34cc-42fb-8e2a-4fcd9edb24cf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Stashing vm_state: active {{(pid=73503) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:15:30 user nova-compute[73503]: INFO nova.compute.claims [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Claim successful on node user
Aug 26 13:15:30 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating resource usage from migration 7b627b46-231e-4e25-a075-75caf9652efd
Aug 26 13:15:30 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.573s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:30 user nova-compute[73503]: INFO nova.compute.manager [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Migrating
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:30 user nova-compute[73503]: INFO nova.compute.rpcapi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG nova.network.neutron [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:30 user nova-compute[73503]: INFO nova.compute.manager [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Terminating instance
Aug 26 13:15:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-630e8ab4-bd27-4db8-9c69-4b85db675bab req-7b7ce9be-ae3f-4886-a1a2-6e0d738cfd7b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-630e8ab4-bd27-4db8-9c69-4b85db675bab req-7b7ce9be-ae3f-4886-a1a2-6e0d738cfd7b service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-630e8ab4-bd27-4db8-9c69-4b85db675bab req-7b7ce9be-ae3f-4886-a1a2-6e0d738cfd7b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-630e8ab4-bd27-4db8-9c69-4b85db675bab req-7b7ce9be-ae3f-4886-a1a2-6e0d738cfd7b service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-630e8ab4-bd27-4db8-9c69-4b85db675bab req-7b7ce9be-ae3f-4886-a1a2-6e0d738cfd7b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-630e8ab4-bd27-4db8-9c69-4b85db675bab req-7b7ce9be-ae3f-4886-a1a2-6e0d738cfd7b service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.network.neutron [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Starting migrate_disk_and_power_off {{(pid=73503) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-7dedc839-49e4-4af6-94cd-121affb3fc8d req-145e86a0-0549-4964-8139-455d7df18532 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7dedc839-49e4-4af6-94cd-121affb3fc8d req-145e86a0-0549-4964-8139-455d7df18532 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7dedc839-49e4-4af6-94cd-121affb3fc8d req-145e86a0-0549-4964-8139-455d7df18532 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7dedc839-49e4-4af6-94cd-121affb3fc8d req-145e86a0-0549-4964-8139-455d7df18532 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-7dedc839-49e4-4af6-94cd-121affb3fc8d req-145e86a0-0549-4964-8139-455d7df18532 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-7dedc839-49e4-4af6-94cd-121affb3fc8d req-145e86a0-0549-4964-8139-455d7df18532 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance destroyed successfully.
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70726c37-f6, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055717.745642, 31572195-0924-47ad-bfe5-01a1266da291 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:32 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 31572195-0924-47ad-bfe5-01a1266da291] VM Stopped (Lifecycle Event)
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-edd76621-4a47-4256-a4b0-1ac02a950d16 None None] [instance: 31572195-0924-47ad-bfe5-01a1266da291] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: INFO os_vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6')
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:32 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[952e91ca-09b3-4a01-94f7-f125e567ea01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cabcc80-133e-41d8-9068-fe248fe9ec2e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:32 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045c2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'): ({'sdf'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Removing single pathed devices sdf {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a354f9-89d7-4fc9-9415-f945c5294dbb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Instance destroyed successfully.
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.objects.instance [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lazy-loading 'resources' on Instance uuid 64455011-34cc-42fb-8e2a-4fcd9edb24cf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[15753fab-f85a-4493-bc05-30b050fc1897]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flushing IO for device /dev/sdf {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9d5a677-83, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb01b6f-ca7a-4b1e-b687-e3cbf5d3ede9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8573d7-f5ca-4ad9-91f9-74bc411ec5da]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:0e:7a,bridge_name='br-int',has_traffic_filtering=True,id=a9d5a677-8385-48ba-8d33-3383fdf4f687,network=Network(3809e78a-9be3-4a28-a320-43bce5be4015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d5a677-83')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f5717c8-c1, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a931c-4a29-4d9d-8222-e1745e133578]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7b:49,bridge_name='br-int',has_traffic_filtering=True,id=5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5f5717c8-c1')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf09da7b5-eb, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c03f9f4-2112-4e10-8a69-8adf5338c86a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]
Aug 26 13:15:33 user nova-compute[73503]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:9f:f7,bridge_name='br-int',has_traffic_filtering=True,id=f09da7b5-eb41-491e-982d-82de621b3d2a,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf09da7b5-eb')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cb94de-0d30-468c-8792-1384df33e30a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== disconnect_volume: return (375ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be3abba-38, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b3:c3,bridge_name='br-int',has_traffic_filtering=True,id=3be3abba-3873-4b42-b7f4-4aff3910c050,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be3abba-38')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "address": "fa:16:3e:ab:0a:69", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4416f37-c3", "ovs_interfaceid": "a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4416f37-c3, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0a:69,bridge_name='br-int',has_traffic_filtering=True,id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b,network=Network(d2fe81f6-9cfc-496c-9d84-831dbd0c4deb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4416f37-c3')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5274f9c-7a, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5274f9c-7a')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1891148154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1891148154',id=11,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgzLiAXycZ6KxgiLDSWE2DRtDMHWFyXvcaxZkgHJ1Rk+ffSIxYbjtbukq/tFxHWOz0XnkmOGzBVpeg0REIHcwBBrRVqr5ik+btUgrjY0FJDHh5EKGCHM4Ev7S+3Giiw+w==',key_name='tempest-keypair-596159842',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc946d3e3fb542dfb75faadf808cacb9',ramdisk_id='',reservation_id='r-8x7d01k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1781926347',owner_user_name='tempest-TaggedBootDevicesTest-1781926347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ac4b7261ce74e05b8ea7defba795dce',uuid=64455011-34cc-42fb-8e2a-4fcd9edb24cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converting VIF {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeabc0f4c-1c, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:33 user nova-compute[73503]: INFO os_vif [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:30:45,bridge_name='br-int',has_traffic_filtering=True,id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0,network=Network(897cf3d6-a994-41c9-b741-6c2444ad1128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeabc0f4c-1c')
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-a9d5a677-8385-48ba-8d33-3383fdf4f687 for instance with vm_state active and task_state deleting.
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state resize_migrating.
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state resize_migrating.
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING nova.compute.manager [req-8109eef6-4933-4b77-8c95-2522ac2c1ee9 req-474db4bc-b0ba-4d1a-ba06-8429dfab7942 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 for instance with vm_state active and task_state deleting.
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpNirOwc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a339bdd6-e5e6-4541-99bc-26b7860a4d2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[152406f8-f661-49d4-b830-691b3c056f7c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30463e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97322894-6558-4ad3-9e9f-3a98464ab800]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877b6f0-2f30-4564-85b5-70ba4424edf2]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[beccf876-7fa0-4801-ab42-1335736083e1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3479ef80-1c1c-44d1-a8e3-5fbfb43ad2d2]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe5482e-3e75-425e-b8eb-3dc380c5ffdd]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787_resize/disk /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc0bd4-0ddd-4b85-8680-b4d8944fcd04]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260]
Aug 26 13:15:33 user nova-compute[73503]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821, portal: 172.16.0.220,3260] successful.
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c1ebe89-27ed-41fa-99f4-32d80615b821 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd7a0f9-93a2-44b1-8e25-8b4e7ee8dffc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== disconnect_volume: return (313ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTdEPZMA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[540dfacf-8e23-4116-8d15-572ea5ae460e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b for instance with vm_state active and task_state deleting.
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:33 user nova-compute[73503]: WARNING nova.compute.manager [req-73005dd4-1d83-4dbf-901b-00ef56fed512 req-722a9026-7116-40c6-b9d2-cadd15e2aeaa service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-e5274f9c-7a71-4e3c-9b01-ec0e02738dea for instance with vm_state active and task_state deleting.
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f269c1db-537e-42b6-8c81-08bf66ce2b51]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045c2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff0b36-ed65-491c-8c3e-9f19ebe42f27]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[757fe161-7f0a-4b0d-9ae5-251b37701554]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[407e0f4f-1659-4d48-b748-553abe9e6fcd]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a49b7-14ac-488f-8eb6-a289dfc92be0]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc815e9e-4e83-4c99-81f2-6fba42ca9668]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0ed532-1fd8-4386-bcff-74866defc20a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260]
Aug 26 13:15:33 user nova-compute[73503]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885, portal: 172.16.0.220,3260] successful.
Aug 26 13:15:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "cp -r /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787_resize/disk /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk" returned: 0 in 0.400s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787_resize/disk.info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk.info {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31379b54-e24e-468b-94dd-b0ba7ab80885 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f7becb-8939-4fcd-948c-7cef80942cfb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "cp -r /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787_resize/disk.info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk.info" returned: 0 in 0.035s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== disconnect_volume: return (346ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XpOCEyle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:34 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de72fc5f-959b-4730-88fd-527740111d3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79e8331-5951-4d13-a5b7-ef752e985bfa]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:34 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 (non-flash)
Aug 26 13:15:34 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd314300040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219'): ({'sdd'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Removing single pathed devices sdd {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[244edec3-2cd7-4150-998a-74e1b964e43d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dcd83c-3705-43b5-94b2-6ba50dbb2af4]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Flushing IO for device /dev/sdd {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f4b79-622a-4a3a-99aa-592e83a01dec]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0a391-0531-4667-b67f-9d4231b873c7]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[119185d0-3c70-4f76-8216-3ff1016c2d3d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b027613-7263-4efa-9cdf-3f718aee45ba]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260]
Aug 26 13:15:34 user nova-compute[73503]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219, portal: 172.16.0.220,3260] successful.
Aug 26 13:15:34 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96be94ef-4d24-4dcd-a20f-57ade65b1219 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fb0a2-4076-408e-b9d8-110c5c388b0b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] <== disconnect_volume: return (307ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:15:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Deleting instance files /opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf_del
Aug 26 13:15:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Deletion of /opt/stack/data/nova/instances/64455011-34cc-42fb-8e2a-4fcd9edb24cf_del complete
Aug 26 13:15:34 user nova-compute[73503]: INFO nova.compute.manager [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Took 3.65 seconds to destroy the instance on the hypervisor.
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-049b470a-cd8e-4e60-b573-ee4c50885908 req-e9882c45-3553-45cb-a4f2-08090fb19bf1 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-049b470a-cd8e-4e60-b573-ee4c50885908 req-e9882c45-3553-45cb-a4f2-08090fb19bf1 service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-049b470a-cd8e-4e60-b573-ee4c50885908 req-e9882c45-3553-45cb-a4f2-08090fb19bf1 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-049b470a-cd8e-4e60-b573-ee4c50885908 req-e9882c45-3553-45cb-a4f2-08090fb19bf1 service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-049b470a-cd8e-4e60-b573-ee4c50885908 req-e9882c45-3553-45cb-a4f2-08090fb19bf1 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-049b470a-cd8e-4e60-b573-ee4c50885908 req-e9882c45-3553-45cb-a4f2-08090fb19bf1 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Port 70726c37-f682-40cd-9155-843aca57acf4 binding to destination host user is already ACTIVE {{(pid=73503) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 13:15:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:36 user nova-compute[73503]: WARNING nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47 for instance with vm_state active and task_state deleting.
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-f09da7b5-eb41-491e-982d-82de621b3d2a for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:36 user nova-compute[73503]: WARNING nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-f09da7b5-eb41-491e-982d-82de621b3d2a for instance with vm_state active and task_state deleting.
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-unplugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-unplugged-3be3abba-3873-4b42-b7f4-4aff3910c050 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Acquiring lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] No waiting events found dispatching network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:36 user nova-compute[73503]: WARNING nova.compute.manager [req-2bc52d6f-4929-45ac-8d76-d808226ed1f2 req-13423761-f54f-40f5-8cc5-167d9e74dbae service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received unexpected event network-vif-plugged-3be3abba-3873-4b42-b7f4-4aff3910c050 for instance with vm_state active and task_state deleting.
Aug 26 13:15:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG os_brick.utils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cf9ad1-f1cf-49b5-91e1-c50d811d65ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfea92c-7ea1-4565-a25c-f3ad7e690e4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58b2b79-d269-496e-93b6-9cfc79bc1b66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da6c8d5-9326-4e39-b141-a7e3b986a4ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:15:37 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:15:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61c21a-04b6-4071-9150-db770b2efb71]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG os_brick.utils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-9a80754a-74b4-42cd-a666-86c23f6051cf req-829db83f-8ee1-4fbf-827b-0181a01b7967 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-deleted-a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:37 user nova-compute[73503]: INFO nova.compute.manager [req-9a80754a-74b4-42cd-a666-86c23f6051cf req-829db83f-8ee1-4fbf-827b-0181a01b7967 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Neutron deleted interface a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b; detaching it from the instance and deleting it from the info cache
Aug 26 13:15:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-9a80754a-74b4-42cd-a666-86c23f6051cf req-829db83f-8ee1-4fbf-827b-0181a01b7967 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3be3abba-3873-4b42-b7f4-4aff3910c050", "address": "fa:16:3e:89:b3:c3", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be3abba-38", "ovs_interfaceid": "3be3abba-3873-4b42-b7f4-4aff3910c050", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-9a80754a-74b4-42cd-a666-86c23f6051cf req-829db83f-8ee1-4fbf-827b-0181a01b7967 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Detach interface failed, port_id=a4416f37-c3bd-4c6e-ab0a-5f722a1dc32b, reason: Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:15:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-deleted-3be3abba-3873-4b42-b7f4-4aff3910c050 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:39 user nova-compute[73503]: INFO nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Neutron deleted interface 3be3abba-3873-4b42-b7f4-4aff3910c050; detaching it from the instance and deleting it from the info cache
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "address": "fa:16:3e:f1:30:45", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeabc0f4c-1c", "ovs_interfaceid": "eabc0f4c-1c64-4c3a-a75a-092cbf4062b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Detach interface failed, port_id=3be3abba-3873-4b42-b7f4-4aff3910c050, reason: Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-deleted-eabc0f4c-1c64-4c3a-a75a-092cbf4062b0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:39 user nova-compute[73503]: INFO nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Neutron deleted interface eabc0f4c-1c64-4c3a-a75a-092cbf4062b0; detaching it from the instance and deleting it from the info cache
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "address": "fa:16:3e:4b:ac:00", "network": {"id": "897cf3d6-a994-41c9-b741-6c2444ad1128", "bridge": "br-int", "label": "tempest-device-tagging-net2-1544069481", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5274f9c-7a", "ovs_interfaceid": "e5274f9c-7a71-4e3c-9b01-ec0e02738dea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:39 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Took 5.43 seconds to deallocate network for instance.
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Detach interface failed, port_id=eabc0f4c-1c64-4c3a-a75a-092cbf4062b0, reason: Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-deleted-e5274f9c-7a71-4e3c-9b01-ec0e02738dea {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:39 user nova-compute[73503]: INFO nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Neutron deleted interface e5274f9c-7a71-4e3c-9b01-ec0e02738dea; detaching it from the instance and deleting it from the info cache
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "address": "fa:16:3e:2e:0e:7a", "network": {"id": "3809e78a-9be3-4a28-a320-43bce5be4015", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1029176737-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d5a677-83", "ovs_interfaceid": "a9d5a677-8385-48ba-8d33-3383fdf4f687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcc6e7de-d3d5-4b48-b61e-803fb43a837a req-e1110ee6-9241-411d-872e-e82b361bf3ab service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Detach interface failed, port_id=e5274f9c-7a71-4e3c-9b01-ec0e02738dea, reason: Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:41 user nova-compute[73503]: INFO nova.compute.manager [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Terminating instance
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-eac7be0a-96f9-4379-80a3-378eb575f42c req-b22d3689-eeed-4bca-821e-5aac67daf4a8 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-vif-unplugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-eac7be0a-96f9-4379-80a3-378eb575f42c req-b22d3689-eeed-4bca-821e-5aac67daf4a8 service nova] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-eac7be0a-96f9-4379-80a3-378eb575f42c req-b22d3689-eeed-4bca-821e-5aac67daf4a8 service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-eac7be0a-96f9-4379-80a3-378eb575f42c req-b22d3689-eeed-4bca-821e-5aac67daf4a8 service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-eac7be0a-96f9-4379-80a3-378eb575f42c req-b22d3689-eeed-4bca-821e-5aac67daf4a8 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] No waiting events found dispatching network-vif-unplugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-eac7be0a-96f9-4379-80a3-378eb575f42c req-b22d3689-eeed-4bca-821e-5aac67daf4a8 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-vif-unplugged-b9017999-d716-42ac-96bd-954bb58e009b for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-9b1411c5-6af9-408f-97cd-d64c3b3e0c5b req-8e5b3c6e-6459-40bf-b930-08c5ee999600 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Received event network-vif-deleted-a9d5a677-8385-48ba-8d33-3383fdf4f687 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:41 user nova-compute[73503]: INFO nova.compute.manager [req-9b1411c5-6af9-408f-97cd-d64c3b3e0c5b req-8e5b3c6e-6459-40bf-b930-08c5ee999600 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Neutron deleted interface a9d5a677-8385-48ba-8d33-3383fdf4f687; detaching it from the instance and deleting it from the info cache
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-9b1411c5-6af9-408f-97cd-d64c3b3e0c5b req-8e5b3c6e-6459-40bf-b930-08c5ee999600 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Updating instance_info_cache with network_info: [{"id": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "address": "fa:16:3e:0d:7b:49", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f5717c8-c1", "ovs_interfaceid": "5f5717c8-c14c-4bf7-a46d-d6bd0fc64a47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f09da7b5-eb41-491e-982d-82de621b3d2a", "address": "fa:16:3e:3a:9f:f7", "network": {"id": "d2fe81f6-9cfc-496c-9d84-831dbd0c4deb", "bridge": "br-int", "label": "tempest-device-tagging-net1-1909450226", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fc946d3e3fb542dfb75faadf808cacb9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf09da7b5-eb", "ovs_interfaceid": "f09da7b5-eb41-491e-982d-82de621b3d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-9b1411c5-6af9-408f-97cd-d64c3b3e0c5b req-8e5b3c6e-6459-40bf-b930-08c5ee999600 service nova] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Detach interface failed, port_id=a9d5a677-8385-48ba-8d33-3383fdf4f687, reason: Instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:15:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Instance destroyed successfully.
Aug 26 13:15:42 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lazy-loading 'resources' on Instance uuid 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1767187518',display_name='tempest-TestVolumeSwap-server-1767187518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1767187518',id=9,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbQqFsqXR3Ly08xP2TTIt1/9Y7XeqcNBJ9MlIvGwM80ClK/nmmdBD/W7J6CT1zVuhmrS4Frud5F6xkZNzwca+5wwvd2AhXrCRg23Efn0ewZcVCJPm4Q8pm8DdFgWUzRdA==',key_name='tempest-keypair-1361842554',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:12:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0999b784caee47ccb23980f5e4a2d788',ramdisk_id='',reservation_id='r-b5ko00w1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-865966160',owner_user_name='tempest-TestVolumeSwap-865966160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:12:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc91bce8f26488ba19fe4392b4b2dc1',uuid=7bf712b0-6ee5-4311-a7e2-d3461af1a8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Converting VIF {"id": "b9017999-d716-42ac-96bd-954bb58e009b", "address": "fa:16:3e:5b:4a:f2", "network": {"id": "dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58", "bridge": "br-int", "label": "tempest-TestVolumeSwap-616099659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0999b784caee47ccb23980f5e4a2d788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9017999-d7", "ovs_interfaceid": "b9017999-d716-42ac-96bd-954bb58e009b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG os_vif [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9017999-d7, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:42 user nova-compute[73503]: INFO os_vif [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:4a:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9017999-d716-42ac-96bd-954bb58e009b,network=Network(dcfd1e9d-b5db-48e5-a5e1-cccc128f0b58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9017999-d7')
Aug 26 13:15:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Deleting instance files /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6_del
Aug 26 13:15:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Deletion of /opt/stack/data/nova/instances/7bf712b0-6ee5-4311-a7e2-d3461af1a8c6_del complete
Aug 26 13:15:42 user nova-compute[73503]: INFO nova.compute.manager [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 26 13:15:42 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:15:42 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:15:43 user nova-compute[73503]: INFO nova.compute.manager [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Took 3.21 seconds to detach 3 volumes for instance.
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:43 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Took 0.98 seconds to deallocate network for instance.
Aug 26 13:15:43 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Deleted allocations for instance 64455011-34cc-42fb-8e2a-4fcd9edb24cf
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-800495f0-ef16-42ca-9fd2-1c75716122bd tempest-TaggedBootDevicesTest-1781926347 tempest-TaggedBootDevicesTest-1781926347-project-member] Lock "64455011-34cc-42fb-8e2a-4fcd9edb24cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.948s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-5d7eade8-79f3-40b8-86c6-9b1444faf3ac req-814f57ff-136e-4fd1-8675-3ac4f0e43253 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5d7eade8-79f3-40b8-86c6-9b1444faf3ac req-814f57ff-136e-4fd1-8675-3ac4f0e43253 service nova] Acquiring lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5d7eade8-79f3-40b8-86c6-9b1444faf3ac req-814f57ff-136e-4fd1-8675-3ac4f0e43253 service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5d7eade8-79f3-40b8-86c6-9b1444faf3ac req-814f57ff-136e-4fd1-8675-3ac4f0e43253 service nova] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-5d7eade8-79f3-40b8-86c6-9b1444faf3ac req-814f57ff-136e-4fd1-8675-3ac4f0e43253 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] No waiting events found dispatching network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:43 user nova-compute[73503]: WARNING nova.compute.manager [req-5d7eade8-79f3-40b8-86c6-9b1444faf3ac req-814f57ff-136e-4fd1-8675-3ac4f0e43253 service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received unexpected event network-vif-plugged-b9017999-d716-42ac-96bd-954bb58e009b for instance with vm_state deleted and task_state None.
Aug 26 13:15:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-e1faa1c8-7ba1-489d-95ff-66eecacea785 req-80b770d0-512a-4c2e-b430-087a8b873b7c service nova] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Received event network-vif-deleted-b9017999-d716-42ac-96bd-954bb58e009b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:44 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:15:44 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:15:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.529s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:44 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Deleted allocations for instance 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6
Aug 26 13:15:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0507db2c-d5bf-4567-bd16-6e4d368eaafc tempest-TestVolumeSwap-865966160 tempest-TestVolumeSwap-865966160-project-member] Lock "7bf712b0-6ee5-4311-a7e2-d3461af1a8c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:47 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055732.623452, 11b30921-6ad1-4c04-8b5b-a98220732787 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:47 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Stopped (Lifecycle Event)
Aug 26 13:15:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b28b8be4-37ab-47ea-aba0-a1f91b90e092 None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b28b8be4-37ab-47ea-aba0-a1f91b90e092 None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:47 user nova-compute[73503]: INFO nova.compute.manager [None req-b28b8be4-37ab-47ea-aba0-a1f91b90e092 None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 13:15:47 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055732.9470167, 64455011-34cc-42fb-8e2a-4fcd9edb24cf => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:48 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] VM Stopped (Lifecycle Event)
Aug 26 13:15:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f5e7df6b-b859-4d13-b84c-e82b8373be79 None None] [instance: 64455011-34cc-42fb-8e2a-4fcd9edb24cf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Starting finish_migration {{(pid=73503) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:15:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Creating image(s)
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk. size=21474836480 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk 21474836480 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk 21474836480" returned: 0 in 0.047s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Ensure instance console log exists: /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start _get_guest_xml network_info=[{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11b30921-6ad1-4c04-8b5b-a98220732787', 'attached_at': '2023-08-26T13:15:49.000000', 'detached_at': '', 'volume_id': '957d26ff-ff9f-404f-bd86-542b3fab7f84', 'serial': '957d26ff-ff9f-404f-bd86-542b3fab7f84'}, 'attachment_id': 'd4229611-c9b6-4087-b10f-7ad654cef419', 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:15:49 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:49 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:15:49 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:49 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:15:49 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e6528d-f9bb-4e43-8dd6-6985ce905c4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:15:49 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f6105-7cde-4a3a-98f8-72b10d585ca4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84] added
Aug 26 13:15:49 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[11504650-d9cf-4483-93ca-55f82edbf8e9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c235273e-4071-4f60-88a8-a00292145e24]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhbSkqZu {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhbSkqZu" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e1c58-98a5-4a7b-8d38-f0dca99b27cb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhbSkqZu'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4978a-9a9f-4d68-a1da-8c8559d47f01]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd24bf01-1adf-48e6-950b-f87453fcc154]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:15:49 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:15:49 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:49 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:15:49 user nova-compute[73503]: 
Aug 26 13:15:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e5ff0-1e14-4876-a911-9659a97b308b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]
Aug 26 13:15:50 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.
Aug 26 13:15:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d4b675-f105-4193-acc5-3881d06c1efa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e7ada-e64d-4175-a43b-6df2273c2ac6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:15:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:15:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b95eb98-f482-401f-9172-0db35d269219]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:15:50 user nova-compute[73503]: INFO nova.compute.manager [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Rescuing
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:15:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23035656662323061', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035656662323061', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:15:51 user nova-compute[73503]:   <uuid>11b30921-6ad1-4c04-8b5b-a98220732787</uuid>
Aug 26 13:15:51 user nova-compute[73503]:   <name>instance-00000005</name>
Aug 26 13:15:51 user nova-compute[73503]:   <memory>2097152</memory>
Aug 26 13:15:51 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:15:51 user nova-compute[73503]:   <metadata>
Aug 26 13:15:51 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:15:51 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:15:51 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherB-server-1082919212</nova:name>
Aug 26 13:15:51 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:15:49</nova:creationTime>
Aug 26 13:15:51 user nova-compute[73503]:       <nova:flavor name="m1.small">
Aug 26 13:15:51 user nova-compute[73503]:         <nova:memory>2048</nova:memory>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:disk>20</nova:disk>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:15:51 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:15:51 user nova-compute[73503]:       <nova:owner>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:user uuid="f9c0aa45010e48a0ba0082cfff7b2cc5">tempest-ServerActionsTestOtherB-100333381-project-member</nova:user>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:project uuid="0f45bb3c25384abfba41a5146a55a7e7">tempest-ServerActionsTestOtherB-100333381</nova:project>
Aug 26 13:15:51 user nova-compute[73503]:       </nova:owner>
Aug 26 13:15:51 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:15:51 user nova-compute[73503]:       <nova:ports>
Aug 26 13:15:51 user nova-compute[73503]:         <nova:port uuid="70726c37-f682-40cd-9155-843aca57acf4">
Aug 26 13:15:51 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:15:51 user nova-compute[73503]:         </nova:port>
Aug 26 13:15:51 user nova-compute[73503]:       </nova:ports>
Aug 26 13:15:51 user nova-compute[73503]:     </nova:instance>
Aug 26 13:15:51 user nova-compute[73503]:   </metadata>
Aug 26 13:15:51 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:15:51 user nova-compute[73503]:     <system>
Aug 26 13:15:51 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:15:51 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:15:51 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:15:51 user nova-compute[73503]:       <entry name="serial">11b30921-6ad1-4c04-8b5b-a98220732787</entry>
Aug 26 13:15:51 user nova-compute[73503]:       <entry name="uuid">11b30921-6ad1-4c04-8b5b-a98220732787</entry>
Aug 26 13:15:51 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:15:51 user nova-compute[73503]:     </system>
Aug 26 13:15:51 user nova-compute[73503]:   </sysinfo>
Aug 26 13:15:51 user nova-compute[73503]:   <os>
Aug 26 13:15:51 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:15:51 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:15:51 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:15:51 user nova-compute[73503]:   </os>
Aug 26 13:15:51 user nova-compute[73503]:   <features>
Aug 26 13:15:51 user nova-compute[73503]:     <acpi/>
Aug 26 13:15:51 user nova-compute[73503]:     <apic/>
Aug 26 13:15:51 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:15:51 user nova-compute[73503]:   </features>
Aug 26 13:15:51 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:15:51 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:15:51 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:15:51 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:15:51 user nova-compute[73503]:   </clock>
Aug 26 13:15:51 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:15:51 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:15:51 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:15:51 user nova-compute[73503]:   </cpu>
Aug 26 13:15:51 user nova-compute[73503]:   <devices>
Aug 26 13:15:51 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:15:51 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:15:51 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk"/>
Aug 26 13:15:51 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:15:51 user nova-compute[73503]:     </disk>
Aug 26 13:15:51 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:15:51 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:15:51 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:15:51 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:15:51 user nova-compute[73503]:       <serial>957d26ff-ff9f-404f-bd86-542b3fab7f84</serial>
Aug 26 13:15:51 user nova-compute[73503]:     </disk>
Aug 26 13:15:51 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:15:51 user nova-compute[73503]:       <mac address="fa:16:3e:c5:4c:46"/>
Aug 26 13:15:51 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:15:51 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:15:51 user nova-compute[73503]:       <target dev="tap70726c37-f6"/>
Aug 26 13:15:51 user nova-compute[73503]:     </interface>
Aug 26 13:15:51 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:15:51 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/console.log" append="off"/>
Aug 26 13:15:51 user nova-compute[73503]:     </serial>
Aug 26 13:15:51 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:15:51 user nova-compute[73503]:     <video>
Aug 26 13:15:51 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:15:51 user nova-compute[73503]:     </video>
Aug 26 13:15:51 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:15:51 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:15:51 user nova-compute[73503]:     </rng>
Aug 26 13:15:51 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:15:51 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:15:51 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:15:51 user nova-compute[73503]:     </memballoon>
Aug 26 13:15:51 user nova-compute[73503]:   </devices>
Aug 26 13:15:51 user nova-compute[73503]: </domain>
Aug 26 13:15:51 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1235919171-network", "vif_mac": "fa:16:3e:c5:4c:46"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG os_vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70726c37-f6, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70726c37-f6, col_values=(('external_ids', {'iface-id': '70726c37-f682-40cd-9155-843aca57acf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:4c:46', 'vm-uuid': '11b30921-6ad1-4c04-8b5b-a98220732787'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: INFO os_vif [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6')
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] No VIF found with MAC fa:16:3e:c5:4c:46, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-980aaff4-8b5c-472c-82cc-7e9e6d2dd4cd req-64b80da7-3949-4827-bbd0-b3e29aef6c50 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-980aaff4-8b5c-472c-82cc-7e9e6d2dd4cd req-64b80da7-3949-4827-bbd0-b3e29aef6c50 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-980aaff4-8b5c-472c-82cc-7e9e6d2dd4cd req-64b80da7-3949-4827-bbd0-b3e29aef6c50 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-980aaff4-8b5c-472c-82cc-7e9e6d2dd4cd req-64b80da7-3949-4827-bbd0-b3e29aef6c50 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-980aaff4-8b5c-472c-82cc-7e9e6d2dd4cd req-64b80da7-3949-4827-bbd0-b3e29aef6c50 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:51 user nova-compute[73503]: WARNING nova.compute.manager [req-980aaff4-8b5c-472c-82cc-7e9e6d2dd4cd req-64b80da7-3949-4827-bbd0-b3e29aef6c50 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state active and task_state rescuing.
Aug 26 13:15:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance destroyed successfully.
Aug 26 13:15:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Attempting rescue
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73503) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:15:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Creating image(s)
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue" returned: 0 in 0.059s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'migration_context' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.base [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<9a0a305a-0375-41a9-9b51-a78d65270f43> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Start _get_guest_xml network_info=[{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:f2:14:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'resources' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.base [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<9a0a305a-0375-41a9-9b51-a78d65270f43> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'numa_topology' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.base [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<9a0a305a-0375-41a9-9b51-a78d65270f43> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:15:52 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:52 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.base [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<9a0a305a-0375-41a9-9b51-a78d65270f43> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1745673538',display_name='tempest-ServerRescueNegativeTestJSON-server-1745673538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1745673538',id=1,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-h9pms00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:11:22Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=9a0a305a-0375-41a9-9b51-a78d65270f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:f2:14:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:f2:14:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.objects.base [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<9a0a305a-0375-41a9-9b51-a78d65270f43> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:15:52 user nova-compute[73503]:   <uuid>9a0a305a-0375-41a9-9b51-a78d65270f43</uuid>
Aug 26 13:15:52 user nova-compute[73503]:   <name>instance-00000001</name>
Aug 26 13:15:52 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:15:52 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:15:52 user nova-compute[73503]:   <metadata>
Aug 26 13:15:52 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:15:52 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:15:52 user nova-compute[73503]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1745673538</nova:name>
Aug 26 13:15:52 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:15:52</nova:creationTime>
Aug 26 13:15:52 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:15:52 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:15:52 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:15:52 user nova-compute[73503]:       <nova:owner>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:user uuid="9cd5b0cb95ba4c6984a9fe5085c87207">tempest-ServerRescueNegativeTestJSON-993610223-project-member</nova:user>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:project uuid="a84b5b1338f040709bafbe65939ac8e7">tempest-ServerRescueNegativeTestJSON-993610223</nova:project>
Aug 26 13:15:52 user nova-compute[73503]:       </nova:owner>
Aug 26 13:15:52 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:15:52 user nova-compute[73503]:       <nova:ports>
Aug 26 13:15:52 user nova-compute[73503]:         <nova:port uuid="d4622b1e-a61d-4f3f-9d72-cec555ea6131">
Aug 26 13:15:52 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 13:15:52 user nova-compute[73503]:         </nova:port>
Aug 26 13:15:52 user nova-compute[73503]:       </nova:ports>
Aug 26 13:15:52 user nova-compute[73503]:     </nova:instance>
Aug 26 13:15:52 user nova-compute[73503]:   </metadata>
Aug 26 13:15:52 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:15:52 user nova-compute[73503]:     <system>
Aug 26 13:15:52 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:15:52 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:15:52 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:15:52 user nova-compute[73503]:       <entry name="serial">9a0a305a-0375-41a9-9b51-a78d65270f43</entry>
Aug 26 13:15:52 user nova-compute[73503]:       <entry name="uuid">9a0a305a-0375-41a9-9b51-a78d65270f43</entry>
Aug 26 13:15:52 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:15:52 user nova-compute[73503]:     </system>
Aug 26 13:15:52 user nova-compute[73503]:   </sysinfo>
Aug 26 13:15:52 user nova-compute[73503]:   <os>
Aug 26 13:15:52 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:15:52 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:15:52 user nova-compute[73503]:   </os>
Aug 26 13:15:52 user nova-compute[73503]:   <features>
Aug 26 13:15:52 user nova-compute[73503]:     <acpi/>
Aug 26 13:15:52 user nova-compute[73503]:     <apic/>
Aug 26 13:15:52 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:15:52 user nova-compute[73503]:   </features>
Aug 26 13:15:52 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:15:52 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:15:52 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:15:52 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:15:52 user nova-compute[73503]:   </clock>
Aug 26 13:15:52 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:15:52 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:15:52 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:15:52 user nova-compute[73503]:   </cpu>
Aug 26 13:15:52 user nova-compute[73503]:   <devices>
Aug 26 13:15:52 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:15:52 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:15:52 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue"/>
Aug 26 13:15:52 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:15:52 user nova-compute[73503]:     </disk>
Aug 26 13:15:52 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:15:52 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:15:52 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk"/>
Aug 26 13:15:52 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:15:52 user nova-compute[73503]:     </disk>
Aug 26 13:15:52 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:15:52 user nova-compute[73503]:       <mac address="fa:16:3e:f2:14:2b"/>
Aug 26 13:15:52 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:15:52 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:15:52 user nova-compute[73503]:       <target dev="tapd4622b1e-a6"/>
Aug 26 13:15:52 user nova-compute[73503]:     </interface>
Aug 26 13:15:52 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:15:52 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/console.log" append="off"/>
Aug 26 13:15:52 user nova-compute[73503]:     </serial>
Aug 26 13:15:52 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:15:52 user nova-compute[73503]:     <video>
Aug 26 13:15:52 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:15:52 user nova-compute[73503]:     </video>
Aug 26 13:15:52 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:15:52 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:15:52 user nova-compute[73503]:     </rng>
Aug 26 13:15:52 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:15:52 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:15:52 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:15:52 user nova-compute[73503]:     </memballoon>
Aug 26 13:15:52 user nova-compute[73503]:   </devices>
Aug 26 13:15:52 user nova-compute[73503]: </domain>
Aug 26 13:15:52 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:15:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance destroyed successfully.
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:15:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:f2:14:2b, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-a4247685-1fc5-4070-a842-dab16e0b5690 req-5e5939ad-8841-4139-99fd-d4b03b232a00 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a4247685-1fc5-4070-a842-dab16e0b5690 req-5e5939ad-8841-4139-99fd-d4b03b232a00 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a4247685-1fc5-4070-a842-dab16e0b5690 req-5e5939ad-8841-4139-99fd-d4b03b232a00 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a4247685-1fc5-4070-a842-dab16e0b5690 req-5e5939ad-8841-4139-99fd-d4b03b232a00 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-a4247685-1fc5-4070-a842-dab16e0b5690 req-5e5939ad-8841-4139-99fd-d4b03b232a00 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:53 user nova-compute[73503]: WARNING nova.compute.manager [req-a4247685-1fc5-4070-a842-dab16e0b5690 req-5e5939ad-8841-4139-99fd-d4b03b232a00 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state resize_finish.
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-826588f7-3a65-4436-9fc0-42917d370134 req-41e40f36-05fb-45e3-8e25-10f733703fa5 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-826588f7-3a65-4436-9fc0-42917d370134 req-41e40f36-05fb-45e3-8e25-10f733703fa5 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-826588f7-3a65-4436-9fc0-42917d370134 req-41e40f36-05fb-45e3-8e25-10f733703fa5 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-826588f7-3a65-4436-9fc0-42917d370134 req-41e40f36-05fb-45e3-8e25-10f733703fa5 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-826588f7-3a65-4436-9fc0-42917d370134 req-41e40f36-05fb-45e3-8e25-10f733703fa5 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:53 user nova-compute[73503]: WARNING nova.compute.manager [req-826588f7-3a65-4436-9fc0-42917d370134 req-41e40f36-05fb-45e3-8e25-10f733703fa5 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state active and task_state rescuing.
Aug 26 13:15:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-de9b16c8-9303-465e-bf56-e51c5ae70d93 req-de1edf60-79fa-4db0-ab65-e21c2bcffb27 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-de9b16c8-9303-465e-bf56-e51c5ae70d93 req-de1edf60-79fa-4db0-ab65-e21c2bcffb27 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-de9b16c8-9303-465e-bf56-e51c5ae70d93 req-de1edf60-79fa-4db0-ab65-e21c2bcffb27 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-de9b16c8-9303-465e-bf56-e51c5ae70d93 req-de1edf60-79fa-4db0-ab65-e21c2bcffb27 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-de9b16c8-9303-465e-bf56-e51c5ae70d93 req-de1edf60-79fa-4db0-ab65-e21c2bcffb27 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:55 user nova-compute[73503]: WARNING nova.compute.manager [req-de9b16c8-9303-465e-bf56-e51c5ae70d93 req-de1edf60-79fa-4db0-ab65-e21c2bcffb27 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state resize_finish.
Aug 26 13:15:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:55 user nova-compute[73503]: WARNING nova.compute.manager [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state active and task_state rescuing.
Aug 26 13:15:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:15:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:15:55 user nova-compute[73503]: WARNING nova.compute.manager [req-29be9b80-d825-49ae-9cc2-baa4e0883da1 req-9255e925-21df-4bd9-8269-a1dc07749f7d service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state active and task_state rescuing.
Aug 26 13:15:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055756.765335, 11b30921-6ad1-4c04-8b5b-a98220732787 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Resumed (Lifecycle Event)
Aug 26 13:15:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:15:56 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance running successfully.
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Failed to set time: agent not configured {{(pid=73503) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-bc8ab94c-2f3c-490a-99df-fe79dae6f719 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] finish_migration finished successfully. {{(pid=73503) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055756.7680597, 11b30921-6ad1-4c04-8b5b-a98220732787 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Started (Lifecycle Event)
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 9a0a305a-0375-41a9-9b51-a78d65270f43 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055757.2789733, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Resumed (Lifecycle Event)
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-09e18936-3cec-469d-bb4f-25bedcb6b627 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055757.2812366, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Started (Lifecycle Event)
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055742.5162728, 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:15:57 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] VM Stopped (Lifecycle Event)
Aug 26 13:15:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f7d425f0-6125-4024-82d7-0def385f807f None None] [instance: 7bf712b0-6ee5-4311-a7e2-d3461af1a8c6] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:16:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:16:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:16:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:16:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:16:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:16:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:16:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:16:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.276s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:16:27 user nova-compute[73503]: INFO nova.compute.claims [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Claim successful on node user
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:16:28 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:16:28 user nova-compute[73503]: INFO nova.virt.block_device [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Booting with volume e49b9918-7c9f-4c7a-88ce-96c07a32aff3 at /dev/vda
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG os_brick.utils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:16:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.policy [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e8a8301938e410c81a2ded0c8e38321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673f05654a4d491eb5cc315db2b77f9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd87156e-65ac-4e82-96bd-58303d62e612]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:16:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=25.411705017089844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d381b-d803-44ea-ae2b-6c46dbe0d0c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b4a9fe-a4b3-4eb4-831e-54d17e426cbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8722c13-91dd-4f15-93ff-c0ed2a5a5cd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:29 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[88364946-411c-43b8-ab45-1a68fc64923d]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG os_brick.utils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== get_connector_properties: return (687ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating existing volume attachment record: 036cddbe-ad84-4eba-ad12-949c167ae7c0 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Applying migration context for instance 11b30921-6ad1-4c04-8b5b-a98220732787 as it has an incoming, in-progress migration 7b627b46-231e-4e25-a075-75caf9652efd. Migration status is finished {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 13:16:29 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating resource usage from migration 7b627b46-231e-4e25-a075-75caf9652efd
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9e6a741c-7b48-43f7-b8c3-344514c48c94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ab4f580b-7abb-45b1-84fd-79957526124a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Migration 7b627b46-231e-4e25-a075-75caf9652efd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:16:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:16:30 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully created port: 896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:16:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:31 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully created port: ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:16:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully created port: 0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:16:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:33 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully created port: 053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:16:34 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully created port: 17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: 896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-896211ce-9a81-4323-9603-1c68cfbef56a. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port 896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ac5c310-eac2-4c1f-b7ec-6cb348275519 req-0480facd-2107-4001-ae22-e05cb37f9878 service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-bbf77752-f982-43cd-baf6-b77c4a13f45d. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c96bae46-98c9-44c4-8dec-f1ee1227dbf5 req-a8059542-ab52-4a2f-8366-67fff401ee76 service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: 9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:39 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-9f7e8485-0e8a-4eb1-bcb5-097e287b2878. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port 9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-ced8d9ae-9851-42ac-8559-9fba5c700ff2. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4502cdba-4aa3-4bf0-960c-bf8373190958 req-ad83d702-5c30-4523-a32a-1c864a19303b service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: 0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-0ef76712-0557-4507-9aa5-9b06e55c423d. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port 0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc1785fd-f4ba-4a47-93aa-e553ade35527 req-d7b12ed1-d9fc-4507-8976-c179455d8856 service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:42 user nova-compute[73503]: INFO nova.virt.block_device [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Booting with volume b63d608a-d45e-4aca-ada0-9d8753daf8ce at /dev/vdb
Aug 26 13:16:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: 053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG os_brick.utils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2d4494-42fe-4823-b23c-36842ae643ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e560d51-fd77-44be-8654-c20d4951026a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[773127af-e1ab-41f3-9607-528deec70671]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc10a73-2851-4993-bdb6-52da78dcf283]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:42 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:16:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c667d-a599-4f74-aabf-b00ed1406a24]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG os_brick.utils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:16:42 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating existing volume attachment record: 99ecca4d-e952-4057-bdd1-c8df668ae923 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:16:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Successfully updated port: 17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:16:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-053a58c2-c89d-4117-8365-8a96922238ab. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance network_info: |[{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port 053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updated VIF entry in instance network info cache for port 053a58c2-c89d-4117-8365-8a96922238ab. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-17a04c8d-f1de-46a2-90f3-11f710099890. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port 17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updated VIF entry in instance network info cache for port 17a04c8d-f1de-46a2-90f3-11f710099890. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:16:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-241fbf80-91c0-4bc3-91e4-176485360790 req-67cf2185-73a9-49e0-927d-2128d6226fd1 service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:16:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:16:49 user nova-compute[73503]: INFO nova.compute.claims [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Claim successful on node user
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:16:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:16:50 user nova-compute[73503]: INFO nova.virt.block_device [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Booting with volume c26782a3-e1d2-47ad-ab79-2def94637c86 at /dev/vda
Aug 26 13:16:50 user nova-compute[73503]: DEBUG nova.policy [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29dbdc58b7f24255988b145cee0cdc15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd48f06574c841cfbce3b3fbe9f18502', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG os_brick.utils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5a224a-6c24-4743-8b4f-73d518ab18fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6d7bcd-9f48-4aa2-9cdd-9e1d27709c9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de208dff-9f74-4a36-bfbc-ca2f956b13e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e2bfb-4803-4e92-becb-ae63d8182a87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:51 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:16:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efe43c6-dd65-46ce-ba86-5906b2af319e]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG os_brick.utils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updating existing volume attachment record: 2fcbe926-3e3c-4b60-8407-7b5d88e97fa0 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:16:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Successfully created port: d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Successfully updated port: d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquired lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-changed-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Refreshing instance network info cache due to event network-changed-d3dc7974-d54e-4973-948a-2097c25cb99a. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] Acquiring lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updating instance_info_cache with network_info: [{"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Releasing lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance network_info: |[{"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:16:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] Acquired lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:16:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Refreshing network info cache for port d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:16:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updated VIF entry in instance network info cache for port d3dc7974-d54e-4973-948a-2097c25cb99a. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:16:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updating instance_info_cache with network_info: [{"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:16:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-81ad4409-6f72-4783-b1e2-9ec8d519af4f req-d45af134-3876-406f-a260-3964c2b74e81 service nova] Releasing lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:16:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:57 user nova-compute[73503]: INFO nova.virt.block_device [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Booting with volume 44e2ba01-0b10-486d-94e6-be34c36bb88c at /dev/vdc
Aug 26 13:16:57 user nova-compute[73503]: DEBUG os_brick.utils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[824081ad-01c3-4a89-9c73-aef79753f1a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5796af-6841-4bd8-a034-d0fc128d8192]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[708d1088-dcb5-4afe-8355-18e371eaefce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7da294-5d72-4baa-a2fc-faec4a1832bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:16:57 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:16:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b997276-58a2-4482-b12a-497f671fe2dd]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG os_brick.utils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:16:57 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating existing volume attachment record: 68a67e38-fb77-4773-8c00-ed599b6471e9 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:16:58 user nova-compute[73503]: INFO nova.compute.manager [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Terminating instance
Aug 26 13:16:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Instance destroyed successfully.
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'resources' on Instance uuid 9e6a741c-7b48-43f7-b8c3-344514c48c94 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2018137376',display_name='tempest-VolumesAdminNegativeTest-server-2018137376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2018137376',id=13,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46148f4972634a4fbd1987020a7a5d85',ramdisk_id='',reservation_id='r-g41mwm6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-762845259',owner_user_name='tempest-VolumesAdminNegativeTest-762845259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:14:50Z,user_data=None,user_id='4e355237acb74d80b008f41672cea5d2',uuid=9e6a741c-7b48-43f7-b8c3-344514c48c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converting VIF {"id": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "address": "fa:16:3e:11:5f:fa", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb778ea7e-c8", "ovs_interfaceid": "b778ea7e-c8bd-4eb8-af66-a6b49373cf4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG os_vif [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb778ea7e-c8, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:16:59 user nova-compute[73503]: INFO os_vif [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:5f:fa,bridge_name='br-int',has_traffic_filtering=True,id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb778ea7e-c8')
Aug 26 13:16:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Deleting instance files /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94_del
Aug 26 13:16:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Deletion of /opt/stack/data/nova/instances/9e6a741c-7b48-43f7-b8c3-344514c48c94_del complete
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-4b58270a-fab4-44b3-8864-60d24b089dc8 req-d0011ec9-618b-4b6f-8e4e-4f19fe6a9a70 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-vif-unplugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4b58270a-fab4-44b3-8864-60d24b089dc8 req-d0011ec9-618b-4b6f-8e4e-4f19fe6a9a70 service nova] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4b58270a-fab4-44b3-8864-60d24b089dc8 req-d0011ec9-618b-4b6f-8e4e-4f19fe6a9a70 service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4b58270a-fab4-44b3-8864-60d24b089dc8 req-d0011ec9-618b-4b6f-8e4e-4f19fe6a9a70 service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-4b58270a-fab4-44b3-8864-60d24b089dc8 req-d0011ec9-618b-4b6f-8e4e-4f19fe6a9a70 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] No waiting events found dispatching network-vif-unplugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-4b58270a-fab4-44b3-8864-60d24b089dc8 req-d0011ec9-618b-4b6f-8e4e-4f19fe6a9a70 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-vif-unplugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:16:59 user nova-compute[73503]: INFO nova.compute.manager [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 13:16:59 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:16:59 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a184fa86-22b8-4f79-ad31-eb586a8d576e req-ad8c1a5d-3f56-4343-aba1-64d4d9ecb480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-vif-deleted-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:00 user nova-compute[73503]: INFO nova.compute.manager [req-a184fa86-22b8-4f79-ad31-eb586a8d576e req-ad8c1a5d-3f56-4343-aba1-64d4d9ecb480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Neutron deleted interface b778ea7e-c8bd-4eb8-af66-a6b49373cf4a; detaching it from the instance and deleting it from the info cache
Aug 26 13:17:00 user nova-compute[73503]: DEBUG nova.network.neutron [req-a184fa86-22b8-4f79-ad31-eb586a8d576e req-ad8c1a5d-3f56-4343-aba1-64d4d9ecb480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a184fa86-22b8-4f79-ad31-eb586a8d576e req-ad8c1a5d-3f56-4343-aba1-64d4d9ecb480 service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Detach interface failed, port_id=b778ea7e-c8bd-4eb8-af66-a6b49373cf4a, reason: Instance 9e6a741c-7b48-43f7-b8c3-344514c48c94 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:17:00 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Took 0.74 seconds to deallocate network for instance.
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'flavor' on Instance uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:00 user nova-compute[73503]: INFO nova.compute.manager [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attaching volume 766572c7-d86f-404c-bfde-2fa4f777233d to /dev/vdb
Aug 26 13:17:01 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG os_brick.utils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9818b-c7ea-4d6a-b025-65df21f95e79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf74504-8941-472d-a8a7-14778e77faa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:01 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Deleted allocations for instance 9e6a741c-7b48-43f7-b8c3-344514c48c94
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff960de2-f57d-4a1b-b74d-522c27c481ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbce0b7-5ec5-43a8-b68a-fa3bc1d1132f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:17:01 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7123b77-f75b-4c1b-963d-fb3a2cc1497a]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG os_brick.utils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating existing volume attachment record: 9d3a7180-9e78-4652-b61f-b692ba1b3b50 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ca3b4aee-94bd-4c62-ad51-980df8416c90 tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-changed-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Refreshing instance network info cache due to event network-changed-5947525d-216d-4665-9d3c-b7c3deadfb70. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] Acquiring lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] Acquired lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG nova.network.neutron [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Refreshing network info cache for port 5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:17:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updated VIF entry in instance network info cache for port 5947525d-216d-4665-9d3c-b7c3deadfb70. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating instance_info_cache with network_info: [{"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] Releasing lock "refresh_cache-ab4f580b-7abb-45b1-84fd-79957526124a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received event network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] Acquiring lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] Lock "9e6a741c-7b48-43f7-b8c3-344514c48c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] No waiting events found dispatching network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:02 user nova-compute[73503]: WARNING nova.compute.manager [req-b5ec035d-8983-4ff9-872f-ef5ccd48d0d7 req-41dade51-f41e-4bb5-bf66-064b69cdd4fd service nova] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Received unexpected event network-vif-plugged-b778ea7e-c8bd-4eb8-af66-a6b49373cf4a for instance with vm_state deleted and task_state None.
Aug 26 13:17:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:17:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:17:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Creating image(s)
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Ensure instance console log exists: /opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Start _get_guest_xml network_info=[{"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26782a3-e1d2-47ad-ab79-2def94637c86', 'serial': 'c26782a3-e1d2-47ad-ab79-2def94637c86'}, 'attachment_id': '2fcbe926-3e3c-4b60-8407-7b5d88e97fa0', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:17:07 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:07 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:07 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:07 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:07 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57778c-239c-49a1-8c0a-898129d66032]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:07 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619608a-539f-407a-8712-5734a31e9ef1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86] added
Aug 26 13:17:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee8aae-447e-47f5-a8c2-4766d4e8ce3d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebeb11c-5ffb-45d1-a9ef-fda430a50878]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFTeqRxN {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFTeqRxN" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55465d3-1e4a-4b30-83f1-123ece008c8f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFTeqRxN'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9ace7-a626-46f7-877f-7637ac672c62]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a9c3e-dda6-4d0d-b6f3-cac1d33cc5a1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eee6fa-4360-4e96-bcf2-7280efec871c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]
Aug 26 13:17:07 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc69af9-f1ae-4ab7-a6ea-ff83fd91ca12]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b4030-56ff-4406-919a-a26d2e053333]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:07 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:07 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9262ce72-df24-46a9-a570-f68088f29b86]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23461376333656534', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461376333656534', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-834091793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-834091793',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpgahKA8CJB13X+LFY/2mON6eWUOF6McKJjH37nhvAmdSCBwTfd3rM3EekabfFigEY0PKAbk6iHI/UNbfPhAHbso39f9MZDKm+ioagie1d7kHWpL+F+SHbQ5tSSQ5Zoxw==',key_name='tempest-keypair-596006166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd48f06574c841cfbce3b3fbe9f18502',ramdisk_id='',reservation_id='r-p723fz9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-331387927',owner_user_name='tempest-ServerActionsV293TestJSON-331387927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dbdc58b7f24255988b145cee0cdc15',uuid=5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converting VIF {"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lazy-loading 'pci_devices' on Instance uuid 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:17:09 user nova-compute[73503]:   <uuid>5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd</uuid>
Aug 26 13:17:09 user nova-compute[73503]:   <name>instance-00000010</name>
Aug 26 13:17:09 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:17:09 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:17:09 user nova-compute[73503]:   <metadata>
Aug 26 13:17:09 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:17:09 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:17:09 user nova-compute[73503]:       <nova:name>tempest-ServerActionsV293TestJSON-server-834091793</nova:name>
Aug 26 13:17:09 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:17:07</nova:creationTime>
Aug 26 13:17:09 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:17:09 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:17:09 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:17:09 user nova-compute[73503]:       <nova:owner>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:user uuid="29dbdc58b7f24255988b145cee0cdc15">tempest-ServerActionsV293TestJSON-331387927-project-member</nova:user>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:project uuid="dd48f06574c841cfbce3b3fbe9f18502">tempest-ServerActionsV293TestJSON-331387927</nova:project>
Aug 26 13:17:09 user nova-compute[73503]:       </nova:owner>
Aug 26 13:17:09 user nova-compute[73503]:       <nova:ports>
Aug 26 13:17:09 user nova-compute[73503]:         <nova:port uuid="d3dc7974-d54e-4973-948a-2097c25cb99a">
Aug 26 13:17:09 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:17:09 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:09 user nova-compute[73503]:       </nova:ports>
Aug 26 13:17:09 user nova-compute[73503]:     </nova:instance>
Aug 26 13:17:09 user nova-compute[73503]:   </metadata>
Aug 26 13:17:09 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:17:09 user nova-compute[73503]:     <system>
Aug 26 13:17:09 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:17:09 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:17:09 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:17:09 user nova-compute[73503]:       <entry name="serial">5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd</entry>
Aug 26 13:17:09 user nova-compute[73503]:       <entry name="uuid">5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd</entry>
Aug 26 13:17:09 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:17:09 user nova-compute[73503]:     </system>
Aug 26 13:17:09 user nova-compute[73503]:   </sysinfo>
Aug 26 13:17:09 user nova-compute[73503]:   <os>
Aug 26 13:17:09 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:17:09 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:17:09 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:17:09 user nova-compute[73503]:   </os>
Aug 26 13:17:09 user nova-compute[73503]:   <features>
Aug 26 13:17:09 user nova-compute[73503]:     <acpi/>
Aug 26 13:17:09 user nova-compute[73503]:     <apic/>
Aug 26 13:17:09 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:17:09 user nova-compute[73503]:   </features>
Aug 26 13:17:09 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:17:09 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:17:09 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:17:09 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:17:09 user nova-compute[73503]:   </clock>
Aug 26 13:17:09 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:17:09 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:17:09 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:17:09 user nova-compute[73503]:   </cpu>
Aug 26 13:17:09 user nova-compute[73503]:   <devices>
Aug 26 13:17:09 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:17:09 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:09 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:17:09 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:17:09 user nova-compute[73503]:       <serial>c26782a3-e1d2-47ad-ab79-2def94637c86</serial>
Aug 26 13:17:09 user nova-compute[73503]:     </disk>
Aug 26 13:17:09 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:09 user nova-compute[73503]:       <mac address="fa:16:3e:7f:54:9d"/>
Aug 26 13:17:09 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:09 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:09 user nova-compute[73503]:       <target dev="tapd3dc7974-d5"/>
Aug 26 13:17:09 user nova-compute[73503]:     </interface>
Aug 26 13:17:09 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:17:09 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd/console.log" append="off"/>
Aug 26 13:17:09 user nova-compute[73503]:     </serial>
Aug 26 13:17:09 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:17:09 user nova-compute[73503]:     <video>
Aug 26 13:17:09 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:09 user nova-compute[73503]:     </video>
Aug 26 13:17:09 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:17:09 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:17:09 user nova-compute[73503]:     </rng>
Aug 26 13:17:09 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:17:09 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:17:09 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:17:09 user nova-compute[73503]:     </memballoon>
Aug 26 13:17:09 user nova-compute[73503]:   </devices>
Aug 26 13:17:09 user nova-compute[73503]: </domain>
Aug 26 13:17:09 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-834091793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-834091793',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpgahKA8CJB13X+LFY/2mON6eWUOF6McKJjH37nhvAmdSCBwTfd3rM3EekabfFigEY0PKAbk6iHI/UNbfPhAHbso39f9MZDKm+ioagie1d7kHWpL+F+SHbQ5tSSQ5Zoxw==',key_name='tempest-keypair-596006166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd48f06574c841cfbce3b3fbe9f18502',ramdisk_id='',reservation_id='r-p723fz9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-331387927',owner_user_name='tempest-ServerActionsV293TestJSON-331387927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dbdc58b7f24255988b145cee0cdc15',uuid=5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converting VIF {"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG os_vif [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3dc7974-d5, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3dc7974-d5, col_values=(('external_ids', {'iface-id': 'd3dc7974-d54e-4973-948a-2097c25cb99a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:54:9d', 'vm-uuid': '5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:09 user nova-compute[73503]: INFO os_vif [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5')
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] No VIF found with MAC fa:16:3e:7f:54:9d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-fb22804f-ae87-4ab9-b4a1-2079321742c9 req-628d2b89-02c2-4f15-8405-5c7881f38609 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fb22804f-ae87-4ab9-b4a1-2079321742c9 req-628d2b89-02c2-4f15-8405-5c7881f38609 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fb22804f-ae87-4ab9-b4a1-2079321742c9 req-628d2b89-02c2-4f15-8405-5c7881f38609 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fb22804f-ae87-4ab9-b4a1-2079321742c9 req-628d2b89-02c2-4f15-8405-5c7881f38609 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-fb22804f-ae87-4ab9-b4a1-2079321742c9 req-628d2b89-02c2-4f15-8405-5c7881f38609 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:11 user nova-compute[73503]: WARNING nova.compute.manager [req-fb22804f-ae87-4ab9-b4a1-2079321742c9 req-628d2b89-02c2-4f15-8405-5c7881f38609 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state building and task_state spawning.
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055833.2837205, 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] VM Resumed (Lifecycle Event)
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance spawned successfully.
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:17:13 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:13 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.425933837890625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055833.2849941, 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] VM Started (Lifecycle Event)
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Applying migration context for instance 11b30921-6ad1-4c04-8b5b-a98220732787 as it has an incoming, in-progress migration 7b627b46-231e-4e25-a075-75caf9652efd. Migration status is finished {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating resource usage from migration 7b627b46-231e-4e25-a075-75caf9652efd
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d78be46-0287-45a3-b251-be8773711c6d req-e6a6685f-b4e5-4058-9bb0-a508e3696826 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d78be46-0287-45a3-b251-be8773711c6d req-e6a6685f-b4e5-4058-9bb0-a508e3696826 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d78be46-0287-45a3-b251-be8773711c6d req-e6a6685f-b4e5-4058-9bb0-a508e3696826 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d78be46-0287-45a3-b251-be8773711c6d req-e6a6685f-b4e5-4058-9bb0-a508e3696826 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d78be46-0287-45a3-b251-be8773711c6d req-e6a6685f-b4e5-4058-9bb0-a508e3696826 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:13 user nova-compute[73503]: WARNING nova.compute.manager [req-6d78be46-0287-45a3-b251-be8773711c6d req-e6a6685f-b4e5-4058-9bb0-a508e3696826 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state building and task_state spawning.
Aug 26 13:17:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:13 user nova-compute[73503]: INFO nova.compute.manager [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Took 24.13 seconds to build instance.
Aug 26 13:17:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9de17f86-c21b-4164-88b3-3b783b68d32c tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.384s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ab4f580b-7abb-45b1-84fd-79957526124a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Migration 7b627b46-231e-4e25-a075-75caf9652efd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:17:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Creating image(s)
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Ensure instance console log exists: /opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Start _get_guest_xml network_info=[{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxTyjXvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e49b9918-7c9f-4c7a-88ce-96c07a32aff3', 'serial': 'e49b9918-7c9f-4c7a-88ce-96c07a32aff3'}, 'attachment_id': '036cddbe-ad84-4eba-ad12-949c167ae7c0', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZrfDCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f', 'attached_at': '', 'detached_at': '', 'volume_id': 'b63d608a-d45e-4aca-ada0-9d8753daf8ce', 'serial': 'b63d608a-d45e-4aca-ada0-9d8753daf8ce'}, 'attachment_id': '99ecca4d-e952-4057-bdd1-c8df668ae923', 'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqevtWPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f', 'attached_at': '', 'detached_at': '', 'volume_id': '44e2ba01-0b10-486d-94e6-be34c36bb88c', 'serial': '44e2ba01-0b10-486d-94e6-be34c36bb88c'}, 'attachment_id': '68a67e38-fb77-4773-8c00-ed599b6471e9', 'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:17:14 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:14 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxTyjXvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:14 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:14 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:14 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39414de-ea57-474f-858c-82bedf9eeba7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:14 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c846ab-da26-4a9b-84fb-1afa80c76a5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3] added
Aug 26 13:17:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70eb08c-f53b-4cc0-b4dc-25fa66ed69e2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cb9a0d-920b-48f4-9751-8f2872544071]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxTyjXvS {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NxTyjXvS" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c226103-80ed-4930-a8fb-3fc7df1afd9c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NxTyjXvS'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d256ed-b70e-4ee0-8165-ea636a931a02]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fb9dfc-11a1-4c03-9fc1-126cc1a9ce96]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055819.5432615, 9e6a741c-7b48-43f7-b8c3-344514c48c94 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:14 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] VM Stopped (Lifecycle Event)
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-eb27749a-fe1a-4893-8696-cfe1d83de6f9 None None] [instance: 9e6a741c-7b48-43f7-b8c3-344514c48c94] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9c9a54-955e-4447-af06-480225c4b017]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260]
Aug 26 13:17:14 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a02b7-0a99-4428-9118-130278e3c175]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecfb65b-8945-4b1d-b386-2b47767546a3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[beadafd5-2f21-44e2-8a29-941cb39a972f]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxTyjXvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.092s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23337663762376633', 'path': '/dev/sdd'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337663762376633', 'path': '/dev/sdd'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZrfDCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:15 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[345c0fd9-7d3c-41e0-a77c-8173574e538d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:15 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[15699e87-167d-4530-8a06-fd0f688881a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce] added
Aug 26 13:17:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfed905-0d94-4d47-9065-c055f64d6419]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58fd1c2-03a7-44f0-a49b-d0f137183a84]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UZrfDCye {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UZrfDCye" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98adf6-53fd-460e-8037-a2c7c2156ed3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UZrfDCye'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ecf9c2-babe-4d4a-82a0-dd9b8c6e24c1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44260015-e96c-4879-ae85-11eee97e875f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:15 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:15 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:15 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:15 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f87293-f5ec-457e-b2af-06300064aabe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260]
Aug 26 13:17:16 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[07735284-f856-43b6-ac83-fe4ec6e16530]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:17:16 user nova-compute[73503]: INFO nova.compute.claims [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Claim successful on node user
Aug 26 13:17:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:16 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.060s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f82e87f-a33f-4645-8df2-d7ce99dc3eb1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:16 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:16 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:16 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:16 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:16 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:16 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.076s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebf15e-c432-4986-9c23-54036f9b4edf]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZrfDCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.137s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== connect_volume: return (1548ms) {'type': 'block', 'scsi_wwn': '23130613465386465', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130613465386465', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.157s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:17 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:17 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568eb9b-80e5-40ac-95ec-701e280c08b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:17 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b433144-2d8c-4079-8497-ce6796eb01ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d] added
Aug 26 13:17:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqevtWPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:17 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e065ad30-1bf8-4aa2-98de-1a6c7714cba5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:17:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8047a431-d426-4fb4-baab-f965c4b2b859]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLrNXqYo {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLrNXqYo" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c762c-58be-4e54-8838-568c2156a025]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLrNXqYo'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef28a4d5-0f1b-4462-86af-b3d4a5e7ae21]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d900f-3792-411e-b4c6-7ec5597a0d64]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:17:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Creating image(s)
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed0234c-f313-4c96-bb87-2cbc633581e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]
Aug 26 13:17:17 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9624925f-ed19-4255-adb5-c11161abe836]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e3a25-290b-4430-af91-6795ddd32581]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:17 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:17 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4974d6c2-f7f3-4318-916f-9af25328f55e]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.222s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk 1073741824" returned: 0 in 0.048s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.policy [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad99f2e83e814a07a9f41d00b6bcecde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92392a06d1e41d49af47410121fabc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Cannot resize image /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Ensure instance console log exists: /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== connect_volume: return (2640ms) {'type': 'block', 'scsi_wwn': '26463313231666331', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313231666331', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.391s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:18 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:18 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'flavor' on Instance uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f318e-1c54-437c-b310-5e32f61e2f24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:18 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61dd31f-5086-4bcd-ad88-f656e4ad82a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c] added
Aug 26 13:17:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:17:18 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:18 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:17:18 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:17:18 user nova-compute[73503]:   <serial>766572c7-d86f-404c-bfde-2fa4f777233d</serial>
Aug 26 13:17:18 user nova-compute[73503]: </disk>
Aug 26 13:17:18 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9b950-0150-4cbb-abcb-aa05234c396a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee076c5-6851-45ac-b7a2-0b3205a700db]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqevtWPA {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hqevtWPA" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7f240-5295-466c-b64c-05f362345527]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hqevtWPA'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[29517e7a-c3c6-4c94-aa25-99d5c4a38687]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767f1bb-eaa3-463a-a005-e81996f33ba9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:18 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e170e-de91-467e-a1ed-c4b6f947d7ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260]
Aug 26 13:17:19 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc489fe0-9ef3-448f-8af5-bd510ce1c9cb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d66dc7c-099d-4461-a3ea-39f0bb0f2a0e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:19 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cfcde8-1646-4e35-9e90-0ab68be7e4cd]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqevtWPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No VIF found with MAC fa:16:3e:cc:2f:32, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Successfully created port: 5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:17:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e560fd26-06b6-458b-be16-a24eabd9b018 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.602s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== connect_volume: return (2839ms) {'type': 'block', 'scsi_wwn': '23734363865303335', 'path': '/dev/sdg'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734363865303335', 'path': '/dev/sdg'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.objects.instance [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lazy-loading 'pci_devices' on Instance uuid acf6501e-5c82-4c7d-a76a-d0a1b8c5305f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:17:20 user nova-compute[73503]:   <uuid>acf6501e-5c82-4c7d-a76a-d0a1b8c5305f</uuid>
Aug 26 13:17:20 user nova-compute[73503]:   <name>instance-0000000f</name>
Aug 26 13:17:20 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:17:20 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:17:20 user nova-compute[73503]:   <metadata>
Aug 26 13:17:20 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:17:20 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:17:20 user nova-compute[73503]:       <nova:name>tempest-device-tagging-server-1302237439</nova:name>
Aug 26 13:17:20 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:17:14</nova:creationTime>
Aug 26 13:17:20 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:17:20 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:17:20 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:17:20 user nova-compute[73503]:       <nova:owner>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:user uuid="5e8a8301938e410c81a2ded0c8e38321">tempest-TaggedBootDevicesTest_v242-1198062199-project-member</nova:user>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:project uuid="673f05654a4d491eb5cc315db2b77f9f">tempest-TaggedBootDevicesTest_v242-1198062199</nova:project>
Aug 26 13:17:20 user nova-compute[73503]:       </nova:owner>
Aug 26 13:17:20 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:17:20 user nova-compute[73503]:       <nova:ports>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="896211ce-9a81-4323-9603-1c68cfbef56a">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="bbf77752-f982-43cd-baf6-b77c4a13f45d">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="9f7e8485-0e8a-4eb1-bcb5-097e287b2878">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="ced8d9ae-9851-42ac-8559-9fba5c700ff2">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.136" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="0ef76712-0557-4507-9aa5-9b06e55c423d">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.1.1.68" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="053a58c2-c89d-4117-8365-8a96922238ab">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:         <nova:port uuid="17a04c8d-f1de-46a2-90f3-11f710099890">
Aug 26 13:17:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 13:17:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:20 user nova-compute[73503]:       </nova:ports>
Aug 26 13:17:20 user nova-compute[73503]:     </nova:instance>
Aug 26 13:17:20 user nova-compute[73503]:   </metadata>
Aug 26 13:17:20 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:17:20 user nova-compute[73503]:     <system>
Aug 26 13:17:20 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:17:20 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:17:20 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:17:20 user nova-compute[73503]:       <entry name="serial">acf6501e-5c82-4c7d-a76a-d0a1b8c5305f</entry>
Aug 26 13:17:20 user nova-compute[73503]:       <entry name="uuid">acf6501e-5c82-4c7d-a76a-d0a1b8c5305f</entry>
Aug 26 13:17:20 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:17:20 user nova-compute[73503]:     </system>
Aug 26 13:17:20 user nova-compute[73503]:   </sysinfo>
Aug 26 13:17:20 user nova-compute[73503]:   <os>
Aug 26 13:17:20 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:17:20 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:17:20 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:17:20 user nova-compute[73503]:   </os>
Aug 26 13:17:20 user nova-compute[73503]:   <features>
Aug 26 13:17:20 user nova-compute[73503]:     <acpi/>
Aug 26 13:17:20 user nova-compute[73503]:     <apic/>
Aug 26 13:17:20 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:17:20 user nova-compute[73503]:   </features>
Aug 26 13:17:20 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:17:20 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:17:20 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:17:20 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:17:20 user nova-compute[73503]:   </clock>
Aug 26 13:17:20 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:17:20 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:17:20 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:17:20 user nova-compute[73503]:   </cpu>
Aug 26 13:17:20 user nova-compute[73503]:   <devices>
Aug 26 13:17:20 user nova-compute[73503]:     <disk type="file" device="cdrom">
Aug 26 13:17:20 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 13:17:20 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f/disk.config"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="hda" bus="ide"/>
Aug 26 13:17:20 user nova-compute[73503]:     </disk>
Aug 26 13:17:20 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:17:20 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:20 user nova-compute[73503]:       <source dev="/dev/sdd"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <serial>e49b9918-7c9f-4c7a-88ce-96c07a32aff3</serial>
Aug 26 13:17:20 user nova-compute[73503]:     </disk>
Aug 26 13:17:20 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:17:20 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:20 user nova-compute[73503]:       <source dev="/dev/sde"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <serial>b63d608a-d45e-4aca-ada0-9d8753daf8ce</serial>
Aug 26 13:17:20 user nova-compute[73503]:     </disk>
Aug 26 13:17:20 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:17:20 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:20 user nova-compute[73503]:       <source dev="/dev/sdg"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="vdc" bus="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <serial>44e2ba01-0b10-486d-94e6-be34c36bb88c</serial>
Aug 26 13:17:20 user nova-compute[73503]:     </disk>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:81:ed:6f"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tap896211ce-9a"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:d6:6a:48"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tapbbf77752-f9"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:e7:b8:e8"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tap9f7e8485-0e"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:a5:27:1b"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tapced8d9ae-98"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:96:20:98"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tap0ef76712-05"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:66:c9:32"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tap053a58c2-c8"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:20 user nova-compute[73503]:       <mac address="fa:16:3e:0e:5e:2f"/>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:20 user nova-compute[73503]:       <target dev="tap17a04c8d-f1"/>
Aug 26 13:17:20 user nova-compute[73503]:     </interface>
Aug 26 13:17:20 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:17:20 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f/console.log" append="off"/>
Aug 26 13:17:20 user nova-compute[73503]:     </serial>
Aug 26 13:17:20 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:17:20 user nova-compute[73503]:     <video>
Aug 26 13:17:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:20 user nova-compute[73503]:     </video>
Aug 26 13:17:20 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:17:20 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:17:20 user nova-compute[73503]:     </rng>
Aug 26 13:17:20 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:17:20 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:17:20 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:17:20 user nova-compute[73503]:     </memballoon>
Aug 26 13:17:20 user nova-compute[73503]:   </devices>
Aug 26 13:17:20 user nova-compute[73503]: </domain>
Aug 26 13:17:20 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896211ce-9a, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap896211ce-9a, col_values=(('external_ids', {'iface-id': '896211ce-9a81-4323-9603-1c68cfbef56a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:ed:6f', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbf77752-f9, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbf77752-f9, col_values=(('external_ids', {'iface-id': 'bbf77752-f982-43cd-baf6-b77c4a13f45d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6a:48', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f7e8485-0e, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f7e8485-0e, col_values=(('external_ids', {'iface-id': '9f7e8485-0e8a-4eb1-bcb5-097e287b2878', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b8:e8', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapced8d9ae-98, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapced8d9ae-98, col_values=(('external_ids', {'iface-id': 'ced8d9ae-9851-42ac-8559-9fba5c700ff2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:27:1b', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ef76712-05, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ef76712-05, col_values=(('external_ids', {'iface-id': '0ef76712-0557-4507-9aa5-9b06e55c423d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:20:98', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Port 70726c37-f682-40cd-9155-843aca57acf4 binding to destination host user is already ACTIVE {{(pid=73503) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap053a58c2-c8, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap053a58c2-c8, col_values=(('external_ids', {'iface-id': '053a58c2-c89d-4117-8365-8a96922238ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:c9:32', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17a04c8d-f1, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17a04c8d-f1, col_values=(('external_ids', {'iface-id': '17a04c8d-f1de-46a2-90f3-11f710099890', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:5e:2f', 'vm-uuid': 'acf6501e-5c82-4c7d-a76a-d0a1b8c5305f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:20 user nova-compute[73503]: INFO os_vif [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1')
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] No BDM found with device name hda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] No VIF found with MAC fa:16:3e:81:ed:6f, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] No VIF found with MAC fa:16:3e:96:20:98, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Using config drive
Aug 26 13:17:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Creating config drive at /opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f/disk.config
Aug 26 13:17:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfu_r9lp2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Successfully updated port: 5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfu_r9lp2" returned: 0 in 0.084s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-changed-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Refreshing instance network info cache due to event network-changed-5bf4353b-4c31-4fe2-928b-b765212e20d5. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:21 user nova-compute[73503]: INFO nova.compute.manager [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Rebuilding instance
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Creating tmpfile /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/tmp71co4rmx to verify with other compute node that the instance is on the same shared storage. {{(pid=73503) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance network_info: |[{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Refreshing network info cache for port 5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Start _get_guest_xml network_info=[{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:17:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1766659861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1766659861',id=17,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENbUsg30RJnWfw6ueTNmDdKUgT/miUT88A3J6urec/DWGrmHyoXfCoNZLgKuV23u9OFYA3ebJdjZf8D8TeMUNIFTmyK3Ijmasq5/b+dFhAXAvLqzisTxs7nsKcHbpRgKQ==',key_name='tempest-keypair-1321173568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-jthfuhzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=de9a2cdb-bee4-4901-8dac-34ca47682cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'pci_devices' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b120820-a402-4bfe-9cb0-464db1f4072c req-0f627018-8138-4e00-84f8-31e5c8258a01 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b120820-a402-4bfe-9cb0-464db1f4072c req-0f627018-8138-4e00-84f8-31e5c8258a01 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b120820-a402-4bfe-9cb0-464db1f4072c req-0f627018-8138-4e00-84f8-31e5c8258a01 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b120820-a402-4bfe-9cb0-464db1f4072c req-0f627018-8138-4e00-84f8-31e5c8258a01 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b120820-a402-4bfe-9cb0-464db1f4072c req-0f627018-8138-4e00-84f8-31e5c8258a01 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:22 user nova-compute[73503]: WARNING nova.compute.manager [req-0b120820-a402-4bfe-9cb0-464db1f4072c req-0f627018-8138-4e00-84f8-31e5c8258a01 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state active and task_state rebuilding.
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:17:22 user nova-compute[73503]:   <uuid>de9a2cdb-bee4-4901-8dac-34ca47682cdf</uuid>
Aug 26 13:17:22 user nova-compute[73503]:   <name>instance-00000011</name>
Aug 26 13:17:22 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:17:22 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:17:22 user nova-compute[73503]:   <metadata>
Aug 26 13:17:22 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:17:22 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:17:22 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1766659861</nova:name>
Aug 26 13:17:22 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:17:22</nova:creationTime>
Aug 26 13:17:22 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:17:22 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:17:22 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:17:22 user nova-compute[73503]:       <nova:owner>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:user uuid="ad99f2e83e814a07a9f41d00b6bcecde">tempest-AttachVolumeShelveTestJSON-568979141-project-member</nova:user>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:project uuid="b92392a06d1e41d49af47410121fabc0">tempest-AttachVolumeShelveTestJSON-568979141</nova:project>
Aug 26 13:17:22 user nova-compute[73503]:       </nova:owner>
Aug 26 13:17:22 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:17:22 user nova-compute[73503]:       <nova:ports>
Aug 26 13:17:22 user nova-compute[73503]:         <nova:port uuid="5bf4353b-4c31-4fe2-928b-b765212e20d5">
Aug 26 13:17:22 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:17:22 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:22 user nova-compute[73503]:       </nova:ports>
Aug 26 13:17:22 user nova-compute[73503]:     </nova:instance>
Aug 26 13:17:22 user nova-compute[73503]:   </metadata>
Aug 26 13:17:22 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:17:22 user nova-compute[73503]:     <system>
Aug 26 13:17:22 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:17:22 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:17:22 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:17:22 user nova-compute[73503]:       <entry name="serial">de9a2cdb-bee4-4901-8dac-34ca47682cdf</entry>
Aug 26 13:17:22 user nova-compute[73503]:       <entry name="uuid">de9a2cdb-bee4-4901-8dac-34ca47682cdf</entry>
Aug 26 13:17:22 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:17:22 user nova-compute[73503]:     </system>
Aug 26 13:17:22 user nova-compute[73503]:   </sysinfo>
Aug 26 13:17:22 user nova-compute[73503]:   <os>
Aug 26 13:17:22 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:17:22 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:17:22 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:17:22 user nova-compute[73503]:   </os>
Aug 26 13:17:22 user nova-compute[73503]:   <features>
Aug 26 13:17:22 user nova-compute[73503]:     <acpi/>
Aug 26 13:17:22 user nova-compute[73503]:     <apic/>
Aug 26 13:17:22 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:17:22 user nova-compute[73503]:   </features>
Aug 26 13:17:22 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:17:22 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:17:22 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:17:22 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:17:22 user nova-compute[73503]:   </clock>
Aug 26 13:17:22 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:17:22 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:17:22 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:17:22 user nova-compute[73503]:   </cpu>
Aug 26 13:17:22 user nova-compute[73503]:   <devices>
Aug 26 13:17:22 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:17:22 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:17:22 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk"/>
Aug 26 13:17:22 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:17:22 user nova-compute[73503]:     </disk>
Aug 26 13:17:22 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:22 user nova-compute[73503]:       <mac address="fa:16:3e:2d:10:f0"/>
Aug 26 13:17:22 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:22 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:22 user nova-compute[73503]:       <target dev="tap5bf4353b-4c"/>
Aug 26 13:17:22 user nova-compute[73503]:     </interface>
Aug 26 13:17:22 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:17:22 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/console.log" append="off"/>
Aug 26 13:17:22 user nova-compute[73503]:     </serial>
Aug 26 13:17:22 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:17:22 user nova-compute[73503]:     <video>
Aug 26 13:17:22 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:22 user nova-compute[73503]:     </video>
Aug 26 13:17:22 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:17:22 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:17:22 user nova-compute[73503]:     </rng>
Aug 26 13:17:22 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:17:22 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:17:22 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:17:22 user nova-compute[73503]:     </memballoon>
Aug 26 13:17:22 user nova-compute[73503]:   </devices>
Aug 26 13:17:22 user nova-compute[73503]: </domain>
Aug 26 13:17:22 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1766659861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1766659861',id=17,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENbUsg30RJnWfw6ueTNmDdKUgT/miUT88A3J6urec/DWGrmHyoXfCoNZLgKuV23u9OFYA3ebJdjZf8D8TeMUNIFTmyK3Ijmasq5/b+dFhAXAvLqzisTxs7nsKcHbpRgKQ==',key_name='tempest-keypair-1321173568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-jthfuhzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=de9a2cdb-bee4-4901-8dac-34ca47682cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG os_vif [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bf4353b-4c, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bf4353b-4c, col_values=(('external_ids', {'iface-id': '5bf4353b-4c31-4fe2-928b-b765212e20d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:10:f0', 'vm-uuid': 'de9a2cdb-bee4-4901-8dac-34ca47682cdf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: INFO os_vif [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c')
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-f8ebb542-d797-4cea-ac81-1d53b6e29826 req-f860fbce-b18e-4e6b-8930-32ac3f6952d7 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f8ebb542-d797-4cea-ac81-1d53b6e29826 req-f860fbce-b18e-4e6b-8930-32ac3f6952d7 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f8ebb542-d797-4cea-ac81-1d53b6e29826 req-f860fbce-b18e-4e6b-8930-32ac3f6952d7 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f8ebb542-d797-4cea-ac81-1d53b6e29826 req-f860fbce-b18e-4e6b-8930-32ac3f6952d7 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-f8ebb542-d797-4cea-ac81-1d53b6e29826 req-f860fbce-b18e-4e6b-8930-32ac3f6952d7 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:22 user nova-compute[73503]: WARNING nova.compute.manager [req-f8ebb542-d797-4cea-ac81-1d53b6e29826 req-f860fbce-b18e-4e6b-8930-32ac3f6952d7 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 13:17:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No VIF found with MAC fa:16:3e:2d:10:f0, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updated VIF entry in instance network info cache for port 5bf4353b-4c31-4fe2-928b-b765212e20d5. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b9a7c8b-017f-440c-8e25-b4e575bfc7e9 req-e2792523-db8d-4328-8dad-79ee1e050e5c service nova] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance destroyed successfully.
Aug 26 13:17:23 user nova-compute[73503]: INFO nova.compute.manager [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Detaching volume 766572c7-d86f-404c-bfde-2fa4f777233d
Aug 26 13:17:23 user nova-compute[73503]: INFO nova.virt.block_device [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attempting to driver detach volume 766572c7-d86f-404c-bfde-2fa4f777233d from mountpoint /dev/vdb
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Attempting to detach device vdb from instance ab4f580b-7abb-45b1-84fd-79957526124a from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:17:23 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:23 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:17:23 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:17:23 user nova-compute[73503]:   <serial>766572c7-d86f-404c-bfde-2fa4f777233d</serial>
Aug 26 13:17:23 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:17:23 user nova-compute[73503]: </disk>
Aug 26 13:17:23 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:17:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully detached device vdb from instance ab4f580b-7abb-45b1-84fd-79957526124a from the persistent domain config.
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:23 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39c93f2-bb28-4d46-a1d2-f8cd2e46aa2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33dd58-80b9-4cbc-949b-245474f85800]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:23 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045efe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'): ({'sdf'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Removing single pathed devices sdf {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ff389-13a8-44a7-b84b-13f9d5bb7212]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c53fd-6651-4fdd-8ce4-5f3c0305fb6f]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flushing IO for device /dev/sdf {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0008cd3-0dc9-4acc-8699-f39177cc22da]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance destroyed successfully.
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'resources' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70726c37-f6, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c010e-8c6d-4b1a-9691-fcb1f69e827a]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25690a3-ff2a-4e39-ba86-ccf192d4c689]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:24 user nova-compute[73503]: INFO os_vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6')
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46bc999-cc7b-49d9-9445-ddd9583ac1e9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]
Aug 26 13:17:24 user nova-compute[73503]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d0fff-056f-4658-b33f-187668ba49f1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== disconnect_volume: return (359ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.054s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[993247fe-b18b-4720-9a5a-80f7a497e38a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5044f6ee-ed49-454d-a4c8-60ab1ff76d20]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:24 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304523ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be8706-d819-41db-bd86-c37ef25dbcb3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c7d33d-7c93-490d-9ded-1e66879e180a]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-d729d541-a5c6-4cf1-aeaf-73c0a658641f req-152ed7ca-e4d5-47cd-a91a-ceff6adc5327 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d729d541-a5c6-4cf1-aeaf-73c0a658641f req-152ed7ca-e4d5-47cd-a91a-ceff6adc5327 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d729d541-a5c6-4cf1-aeaf-73c0a658641f req-152ed7ca-e4d5-47cd-a91a-ceff6adc5327 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d729d541-a5c6-4cf1-aeaf-73c0a658641f req-152ed7ca-e4d5-47cd-a91a-ceff6adc5327 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-d729d541-a5c6-4cf1-aeaf-73c0a658641f req-152ed7ca-e4d5-47cd-a91a-ceff6adc5327 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:24 user nova-compute[73503]: WARNING nova.compute.manager [req-d729d541-a5c6-4cf1-aeaf-73c0a658641f req-152ed7ca-e4d5-47cd-a91a-ceff6adc5327 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state active and task_state rebuilding.
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12afd3d-2e70-4ea9-bae7-d88447e5014d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b374fc-f476-4114-92cb-07e544bb56d4]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ce4bf-9ec9-48f7-8a30-0be037412e96]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9f1ec-04f6-4f69-9bc7-76743a1b4835]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]
Aug 26 13:17:24 user nova-compute[73503]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4090cf8e-e309-4e0b-96de-0101e42aacaf]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== disconnect_volume: return (406ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-87b6f7e3-ddd1-4a31-863d-9cacea5ebe93 req-f3317259-76ab-4171-b53e-155caa667300 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-87b6f7e3-ddd1-4a31-863d-9cacea5ebe93 req-f3317259-76ab-4171-b53e-155caa667300 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-87b6f7e3-ddd1-4a31-863d-9cacea5ebe93 req-f3317259-76ab-4171-b53e-155caa667300 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-87b6f7e3-ddd1-4a31-863d-9cacea5ebe93 req-f3317259-76ab-4171-b53e-155caa667300 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-87b6f7e3-ddd1-4a31-863d-9cacea5ebe93 req-f3317259-76ab-4171-b53e-155caa667300 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:24 user nova-compute[73503]: WARNING nova.compute.manager [req-87b6f7e3-ddd1-4a31-863d-9cacea5ebe93 req-f3317259-76ab-4171-b53e-155caa667300 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 13:17:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance destroyed successfully.
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1683915817',display_name='tempest-ServerActionsTestOtherA-server-537947146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1683915817',id=14,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FicSYtb+XZMerD16xYzO8q+U3g8rcG5d5MFbKomScizcC0+Fw0fIAVHBROQZJpRPR1Ifo9emWEM9YNTyE+juaAPyhTubC/2jYPI8N8OQIO3i32kDqa2jmMSSw5sG/yA==',key_name='tempest-keypair-1153890614',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-l71x2txa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ab4f580b-7abb-45b1-84fd-79957526124a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5947525d-21, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:25 user nova-compute[73503]: INFO os_vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21')
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:25 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d39da1-561d-4aa7-b154-cabe3f183254]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cde36-7f84-4283-bb07-09d81760b687]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:25 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:25 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:25 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:25 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:25 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:25 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30463f910>, {}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Disconnecting from: [] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== disconnect_volume: return (77ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:17:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Deleting instance files /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a_del
Aug 26 13:17:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Deletion of /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a_del complete
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.007s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'migration_context' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:25 user nova-compute[73503]: DEBUG nova.objects.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Object Instance<11b30921-6ad1-4c04-8b5b-a98220732787> lazy-loaded attributes: resources,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:17:26 user nova-compute[73503]: INFO nova.virt.block_device [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Booting with volume 766572c7-d86f-404c-bfde-2fa4f777233d at /dev/vdb
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG os_brick.utils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e42710f-c8c4-43b5-a076-d288abdac93c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f54ff-8c71-4ffd-a13d-1085cee5880f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[572868d8-1c0b-4ead-89ae-9f018d26d745]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ec0d9-470e-4ba6-8f9c-6a3fa6701dfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c6f01619-e1dc-42a8-8bb9-ff095cd43aff req-4723e470-a138-4c15-a01d-6ec71e4e66c7 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c6f01619-e1dc-42a8-8bb9-ff095cd43aff req-4723e470-a138-4c15-a01d-6ec71e4e66c7 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c6f01619-e1dc-42a8-8bb9-ff095cd43aff req-4723e470-a138-4c15-a01d-6ec71e4e66c7 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c6f01619-e1dc-42a8-8bb9-ff095cd43aff req-4723e470-a138-4c15-a01d-6ec71e4e66c7 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-c6f01619-e1dc-42a8-8bb9-ff095cd43aff req-4723e470-a138-4c15-a01d-6ec71e4e66c7 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:26 user nova-compute[73503]: WARNING nova.compute.manager [req-c6f01619-e1dc-42a8-8bb9-ff095cd43aff req-4723e470-a138-4c15-a01d-6ec71e4e66c7 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state building and task_state spawning.
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:17:26 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2306c8ca-8ce6-458f-ac49-87bb0aec55e2]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG os_brick.utils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating existing volume attachment record: a2786a6c-832c-4ac5-948b-ccf0d1645e30 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.744s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:26 user nova-compute[73503]: WARNING nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a for instance with vm_state building and task_state spawning.
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:26 user nova-compute[73503]: WARNING nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a for instance with vm_state building and task_state spawning.
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:26 user nova-compute[73503]: WARNING nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d for instance with vm_state building and task_state spawning.
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:26 user nova-compute[73503]: WARNING nova.compute.manager [req-a586e41f-7221-4800-9ada-c145083925c1 req-a78b70c4-d331-4664-9eab-6b6c537eab8a service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d for instance with vm_state building and task_state spawning.
Aug 26 13:17:26 user nova-compute[73503]: INFO nova.compute.manager [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Swapping old allocation on dict_keys(['8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2']) held by migration 7b627b46-231e-4e25-a075-75caf9652efd for instance
Aug 26 13:17:26 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Overwriting current allocation {'allocations': {'8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '0f45bb3c25384abfba41a5146a55a7e7', 'user_id': 'f9c0aa45010e48a0ba0082cfff7b2cc5', 'consumer_generation': 1} on consumer 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquired lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Releasing lock "refresh_cache-11b30921-6ad1-4c04-8b5b-a98220732787" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG os_brick.utils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc69cc6f-2383-4123-b1f8-4b6c767bd6c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d13129-b7f9-4853-8c64-6be0cd380dc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a417cffa-497a-4073-b153-c09b8f62a861]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b950e5dd-f168-4ac7-b96e-7af0dfd41059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:17:27 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:17:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[26296b38-bc7a-4ad6-8461-a90614a5fba2]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG os_brick.utils [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-0b6585c8-b77b-46db-a8b2-cab467109831 req-f0e7a950-4316-461b-9299-f38a4e8d8af1 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:28 user nova-compute[73503]: WARNING nova.compute.manager [req-f9cef4bd-06bd-4469-8af7-04407b8224a9 req-622cc1e6-220b-4aeb-8ac2-b0b101a1a060 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab for instance with vm_state building and task_state spawning.
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055849.1077406, de9a2cdb-bee4-4901-8dac-34ca47682cdf => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] VM Resumed (Lifecycle Event)
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance spawned successfully.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055849.1089659, de9a2cdb-bee4-4901-8dac-34ca47682cdf => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] VM Started (Lifecycle Event)
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Took 11.71 seconds to spawn the instance on the hypervisor.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_power_states {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Took 13.44 seconds to build instance.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8429e295-9e86-42d0-9949-15f5362f6c1d tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.598s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: WARNING nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] While synchronizing instance power states, found 10 instances in the database and 8 instances on the hypervisor.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 950df9cd-10d7-45cb-9714-9ee01f508acd {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 7bf15cad-4bbf-4d7f-b811-7cf79758e1af {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid acf6501e-5c82-4c7d-a76a-d0a1b8c5305f {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:29 user nova-compute[73503]: INFO nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.155s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055850.5531008, acf6501e-5c82-4c7d-a76a-d0a1b8c5305f => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] VM Resumed (Lifecycle Event)
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance spawned successfully.
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055850.5568254, acf6501e-5c82-4c7d-a76a-d0a1b8c5305f => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] VM Started (Lifecycle Event)
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-f1011b5c-698e-4605-a6a0-7aa31f83c2c4 req-fff411a5-e3b4-4300-ad03-e48b5ba2768c service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f1011b5c-698e-4605-a6a0-7aa31f83c2c4 req-fff411a5-e3b4-4300-ad03-e48b5ba2768c service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f1011b5c-698e-4605-a6a0-7aa31f83c2c4 req-fff411a5-e3b4-4300-ad03-e48b5ba2768c service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f1011b5c-698e-4605-a6a0-7aa31f83c2c4 req-fff411a5-e3b4-4300-ad03-e48b5ba2768c service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-f1011b5c-698e-4605-a6a0-7aa31f83c2c4 req-fff411a5-e3b4-4300-ad03-e48b5ba2768c service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:30 user nova-compute[73503]: WARNING nova.compute.manager [req-f1011b5c-698e-4605-a6a0-7aa31f83c2c4 req-fff411a5-e3b4-4300-ad03-e48b5ba2768c service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 for instance with vm_state building and task_state spawning.
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Took 16.57 seconds to spawn the instance on the hypervisor.
Aug 26 13:17:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Took 63.38 seconds to build instance.
Aug 26 13:17:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-32ee5a2b-85d4-4ef1-a1b4-229222ee68e5 tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 63.524s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.359s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:30 user nova-compute[73503]: INFO nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "45a45e79-86a3-40a8-96bc-7437cf769580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:17:34 user nova-compute[73503]: INFO nova.compute.claims [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Claim successful on node user
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:17:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.policy [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a89a1af8a5843ed93bf6f11556e1f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b965a76e3c04068b81deca48c6efba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:17:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Creating image(s)
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "/opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.321s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.240s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk 1073741824" returned: 0 in 0.056s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Successfully created port: e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.243s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:17:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Cannot resize image /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Ensure instance console log exists: /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Successfully updated port: e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-changed-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Refreshing instance network info cache due to event network-changed-e3004e08-6b95-40d8-a434-97b177dfe352. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] Acquiring lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Instance network_info: |[{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] Acquired lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Refreshing network info cache for port e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Start _get_guest_xml network_info=[{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:17:37 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:37 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1173368871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1173368871',id=18,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-odfd8dm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:35Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=45a45e79-86a3-40a8-96bc-7437cf769580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'pci_devices' on Instance uuid 45a45e79-86a3-40a8-96bc-7437cf769580 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:17:37 user nova-compute[73503]:   <uuid>45a45e79-86a3-40a8-96bc-7437cf769580</uuid>
Aug 26 13:17:37 user nova-compute[73503]:   <name>instance-00000012</name>
Aug 26 13:17:37 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:17:37 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:17:37 user nova-compute[73503]:   <metadata>
Aug 26 13:17:37 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:17:37 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:17:37 user nova-compute[73503]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1173368871</nova:name>
Aug 26 13:17:37 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:17:37</nova:creationTime>
Aug 26 13:17:37 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:17:37 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:17:37 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:17:37 user nova-compute[73503]:       <nova:owner>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:user uuid="1a89a1af8a5843ed93bf6f11556e1f65">tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member</nova:user>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:project uuid="9b965a76e3c04068b81deca48c6efba6">tempest-ServerBootFromVolumeStableRescueTest-1652147779</nova:project>
Aug 26 13:17:37 user nova-compute[73503]:       </nova:owner>
Aug 26 13:17:37 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:17:37 user nova-compute[73503]:       <nova:ports>
Aug 26 13:17:37 user nova-compute[73503]:         <nova:port uuid="e3004e08-6b95-40d8-a434-97b177dfe352">
Aug 26 13:17:37 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:17:37 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:37 user nova-compute[73503]:       </nova:ports>
Aug 26 13:17:37 user nova-compute[73503]:     </nova:instance>
Aug 26 13:17:37 user nova-compute[73503]:   </metadata>
Aug 26 13:17:37 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:17:37 user nova-compute[73503]:     <system>
Aug 26 13:17:37 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:17:37 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:17:37 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:17:37 user nova-compute[73503]:       <entry name="serial">45a45e79-86a3-40a8-96bc-7437cf769580</entry>
Aug 26 13:17:37 user nova-compute[73503]:       <entry name="uuid">45a45e79-86a3-40a8-96bc-7437cf769580</entry>
Aug 26 13:17:37 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:17:37 user nova-compute[73503]:     </system>
Aug 26 13:17:37 user nova-compute[73503]:   </sysinfo>
Aug 26 13:17:37 user nova-compute[73503]:   <os>
Aug 26 13:17:37 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:17:37 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:17:37 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:17:37 user nova-compute[73503]:   </os>
Aug 26 13:17:37 user nova-compute[73503]:   <features>
Aug 26 13:17:37 user nova-compute[73503]:     <acpi/>
Aug 26 13:17:37 user nova-compute[73503]:     <apic/>
Aug 26 13:17:37 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:17:37 user nova-compute[73503]:   </features>
Aug 26 13:17:37 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:17:37 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:17:37 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:17:37 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:17:37 user nova-compute[73503]:   </clock>
Aug 26 13:17:37 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:17:37 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:17:37 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:17:37 user nova-compute[73503]:   </cpu>
Aug 26 13:17:37 user nova-compute[73503]:   <devices>
Aug 26 13:17:37 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:17:37 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:17:37 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk"/>
Aug 26 13:17:37 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:17:37 user nova-compute[73503]:     </disk>
Aug 26 13:17:37 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:37 user nova-compute[73503]:       <mac address="fa:16:3e:cd:62:11"/>
Aug 26 13:17:37 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:37 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:37 user nova-compute[73503]:       <target dev="tape3004e08-6b"/>
Aug 26 13:17:37 user nova-compute[73503]:     </interface>
Aug 26 13:17:37 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:17:37 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/console.log" append="off"/>
Aug 26 13:17:37 user nova-compute[73503]:     </serial>
Aug 26 13:17:37 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:17:37 user nova-compute[73503]:     <video>
Aug 26 13:17:37 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:37 user nova-compute[73503]:     </video>
Aug 26 13:17:37 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:17:37 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:17:37 user nova-compute[73503]:     </rng>
Aug 26 13:17:37 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:17:37 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:17:37 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:17:37 user nova-compute[73503]:     </memballoon>
Aug 26 13:17:37 user nova-compute[73503]:   </devices>
Aug 26 13:17:37 user nova-compute[73503]: </domain>
Aug 26 13:17:37 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1173368871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1173368871',id=18,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-odfd8dm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:35Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=45a45e79-86a3-40a8-96bc-7437cf769580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG os_vif [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3004e08-6b, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3004e08-6b, col_values=(('external_ids', {'iface-id': 'e3004e08-6b95-40d8-a434-97b177dfe352', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:62:11', 'vm-uuid': '45a45e79-86a3-40a8-96bc-7437cf769580'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:37 user nova-compute[73503]: INFO os_vif [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b')
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No VIF found with MAC fa:16:3e:cd:62:11, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updated VIF entry in instance network info cache for port e3004e08-6b95-40d8-a434-97b177dfe352. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8cc1cdff-43c1-423d-bac5-638fa067ca86 req-d1aa3ae0-f93e-428a-b7db-4f42a966b571 service nova] Releasing lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:38 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055843.4399188, ab4f580b-7abb-45b1-84fd-79957526124a => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:38 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] VM Stopped (Lifecycle Event)
Aug 26 13:17:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c36e2449-6bce-4f14-8bef-6c19b2099764 None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:38 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055843.8469858, 11b30921-6ad1-4c04-8b5b-a98220732787 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:38 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Stopped (Lifecycle Event)
Aug 26 13:17:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-17c99863-2dd8-4eeb-8d81-aa0f904547e4 None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-53287371-aa23-49e2-9acf-4f81a69307d2 req-8ea9ca04-efcb-40ca-945e-d4c92eb63bf6 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-53287371-aa23-49e2-9acf-4f81a69307d2 req-8ea9ca04-efcb-40ca-945e-d4c92eb63bf6 service nova] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-53287371-aa23-49e2-9acf-4f81a69307d2 req-8ea9ca04-efcb-40ca-945e-d4c92eb63bf6 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-53287371-aa23-49e2-9acf-4f81a69307d2 req-8ea9ca04-efcb-40ca-945e-d4c92eb63bf6 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-53287371-aa23-49e2-9acf-4f81a69307d2 req-8ea9ca04-efcb-40ca-945e-d4c92eb63bf6 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] No waiting events found dispatching network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:39 user nova-compute[73503]: WARNING nova.compute.manager [req-53287371-aa23-49e2-9acf-4f81a69307d2 req-8ea9ca04-efcb-40ca-945e-d4c92eb63bf6 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received unexpected event network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 for instance with vm_state building and task_state spawning.
Aug 26 13:17:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:17:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Creating image(s)
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk 1073741824" returned: 0 in 0.048s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.236s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-8255da73-0b31-48ca-9897-5893beae5e4e req-c73b8bf5-586a-4c16-83b1-4488773da693 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8255da73-0b31-48ca-9897-5893beae5e4e req-c73b8bf5-586a-4c16-83b1-4488773da693 service nova] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8255da73-0b31-48ca-9897-5893beae5e4e req-c73b8bf5-586a-4c16-83b1-4488773da693 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8255da73-0b31-48ca-9897-5893beae5e4e req-c73b8bf5-586a-4c16-83b1-4488773da693 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-8255da73-0b31-48ca-9897-5893beae5e4e req-c73b8bf5-586a-4c16-83b1-4488773da693 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] No waiting events found dispatching network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:41 user nova-compute[73503]: WARNING nova.compute.manager [req-8255da73-0b31-48ca-9897-5893beae5e4e req-c73b8bf5-586a-4c16-83b1-4488773da693 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received unexpected event network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 for instance with vm_state building and task_state spawning.
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Cannot resize image /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Ensure instance console log exists: /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Start _get_guest_xml network_info=[{"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ab4f580b-7abb-45b1-84fd-79957526124a', 'attached_at': '', 'detached_at': '', 'volume_id': '766572c7-d86f-404c-bfde-2fa4f777233d', 'serial': '766572c7-d86f-404c-bfde-2fa4f777233d'}, 'attachment_id': 'a2786a6c-832c-4ac5-948b-ccf0d1645e30', 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:17:41 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 13:17:41 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.objects.instance [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:41 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:41 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:41 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055861.7934341, 45a45e79-86a3-40a8-96bc-7437cf769580 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] VM Resumed (Lifecycle Event)
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Instance spawned successfully.
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d444ffb-5c35-4ed3-b1b4-f8c06eecfda9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:41 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b47a14-b9a7-4a86-a412-b02b485b0140]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d] added
Aug 26 13:17:41 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055861.7937748, 45a45e79-86a3-40a8-96bc-7437cf769580 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] VM Started (Lifecycle Event)
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeb6b84-9cd7-40a6-81f4-4d13f3799d9a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.compute.manager [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Unrescuing
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5cfe52-01f0-43f0-8ec9-4b4f46ca32c2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLrNXqYo {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLrNXqYo" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f61d0d8-9f8f-419c-b695-09d41d81abf8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLrNXqYo'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:41 user nova-compute[73503]: INFO nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 26 13:17:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd62f007-a9a8-44bf-b02a-0d1326af3b73]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[067624fa-1bf3-4223-9794-01ec6721413c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:42 user nova-compute[73503]: INFO nova.compute.manager [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Took 8.11 seconds to build instance.
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5166023e-251e-4e9f-873d-5d0824671181 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "45a45e79-86a3-40a8-96bc-7437cf769580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.214s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ade6bad-4e9a-4d66-9b09-386e82837856]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]
Aug 26 13:17:42 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e5c10-d952-4d3a-b907-7ddc7a30b39b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbda27d-ea0d-46e5-a67d-f785ac61938d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:42 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f7a38e-5cfb-45f5-ac77-2e43ba610f49]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Starting finish_revert_migration {{(pid=73503) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start _get_guest_xml network_info=[{"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '11b30921-6ad1-4c04-8b5b-a98220732787', 'attached_at': '2023-08-26T13:17:42.000000', 'detached_at': '', 'volume_id': '957d26ff-ff9f-404f-bd86-542b3fab7f84', 'serial': '957d26ff-ff9f-404f-bd86-542b3fab7f84'}, 'attachment_id': '45a4f4eb-602f-41ea-b550-295b6b925a83', 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:17:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:17:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG nova.objects.instance [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'flavor' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-a3999f55-a06d-4406-bd59-21f92668dfe7 req-b742867b-46d1-4281-aecd-2c777bb8f407 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a3999f55-a06d-4406-bd59-21f92668dfe7 req-b742867b-46d1-4281-aecd-2c777bb8f407 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a3999f55-a06d-4406-bd59-21f92668dfe7 req-b742867b-46d1-4281-aecd-2c777bb8f407 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a3999f55-a06d-4406-bd59-21f92668dfe7 req-b742867b-46d1-4281-aecd-2c777bb8f407 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-a3999f55-a06d-4406-bd59-21f92668dfe7 req-b742867b-46d1-4281-aecd-2c777bb8f407 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:43 user nova-compute[73503]: WARNING nova.compute.manager [req-a3999f55-a06d-4406-bd59-21f92668dfe7 req-b742867b-46d1-4281-aecd-2c777bb8f407 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26463313231666331', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313231666331', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.633s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:17:43 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1683915817',display_name='tempest-ServerActionsTestOtherA-server-537947146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1683915817',id=14,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FicSYtb+XZMerD16xYzO8q+U3g8rcG5d5MFbKomScizcC0+Fw0fIAVHBROQZJpRPR1Ifo9emWEM9YNTyE+juaAPyhTubC/2jYPI8N8OQIO3i32kDqa2jmMSSw5sG/yA==',key_name='tempest-keypair-1153890614',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-l71x2txa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ab4f580b-7abb-45b1-84fd-79957526124a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:17:43 user nova-compute[73503]:   <uuid>ab4f580b-7abb-45b1-84fd-79957526124a</uuid>
Aug 26 13:17:43 user nova-compute[73503]:   <name>instance-0000000e</name>
Aug 26 13:17:43 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:17:43 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:17:43 user nova-compute[73503]:   <metadata>
Aug 26 13:17:43 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:17:43 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:17:43 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherA-server-537947146</nova:name>
Aug 26 13:17:43 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:17:41</nova:creationTime>
Aug 26 13:17:43 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:17:43 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:17:43 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:17:43 user nova-compute[73503]:       <nova:owner>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:user uuid="2a9851519cfc49c388894f0884261586">tempest-ServerActionsTestOtherA-856596274-project-member</nova:user>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:project uuid="9f8967f8280045e8b45d9298bda30914">tempest-ServerActionsTestOtherA-856596274</nova:project>
Aug 26 13:17:43 user nova-compute[73503]:       </nova:owner>
Aug 26 13:17:43 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:17:43 user nova-compute[73503]:       <nova:ports>
Aug 26 13:17:43 user nova-compute[73503]:         <nova:port uuid="5947525d-216d-4665-9d3c-b7c3deadfb70">
Aug 26 13:17:43 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:17:43 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:43 user nova-compute[73503]:       </nova:ports>
Aug 26 13:17:43 user nova-compute[73503]:     </nova:instance>
Aug 26 13:17:43 user nova-compute[73503]:   </metadata>
Aug 26 13:17:43 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:17:43 user nova-compute[73503]:     <system>
Aug 26 13:17:43 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:17:43 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:17:43 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:17:43 user nova-compute[73503]:       <entry name="serial">ab4f580b-7abb-45b1-84fd-79957526124a</entry>
Aug 26 13:17:43 user nova-compute[73503]:       <entry name="uuid">ab4f580b-7abb-45b1-84fd-79957526124a</entry>
Aug 26 13:17:43 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:17:43 user nova-compute[73503]:     </system>
Aug 26 13:17:43 user nova-compute[73503]:   </sysinfo>
Aug 26 13:17:43 user nova-compute[73503]:   <os>
Aug 26 13:17:43 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:17:43 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:17:43 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:17:43 user nova-compute[73503]:   </os>
Aug 26 13:17:43 user nova-compute[73503]:   <features>
Aug 26 13:17:43 user nova-compute[73503]:     <acpi/>
Aug 26 13:17:43 user nova-compute[73503]:     <apic/>
Aug 26 13:17:43 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:17:43 user nova-compute[73503]:   </features>
Aug 26 13:17:43 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:17:43 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:17:43 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:17:43 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:17:43 user nova-compute[73503]:   </clock>
Aug 26 13:17:43 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:17:43 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:17:43 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:17:43 user nova-compute[73503]:   </cpu>
Aug 26 13:17:43 user nova-compute[73503]:   <devices>
Aug 26 13:17:43 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:17:43 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:17:43 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk"/>
Aug 26 13:17:43 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:17:43 user nova-compute[73503]:     </disk>
Aug 26 13:17:43 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:17:43 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:43 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:17:43 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:17:43 user nova-compute[73503]:       <serial>766572c7-d86f-404c-bfde-2fa4f777233d</serial>
Aug 26 13:17:43 user nova-compute[73503]:     </disk>
Aug 26 13:17:43 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:43 user nova-compute[73503]:       <mac address="fa:16:3e:cc:2f:32"/>
Aug 26 13:17:43 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:43 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:43 user nova-compute[73503]:       <target dev="tap5947525d-21"/>
Aug 26 13:17:43 user nova-compute[73503]:     </interface>
Aug 26 13:17:43 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:17:43 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/console.log" append="off"/>
Aug 26 13:17:43 user nova-compute[73503]:     </serial>
Aug 26 13:17:43 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:17:43 user nova-compute[73503]:     <video>
Aug 26 13:17:43 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:43 user nova-compute[73503]:     </video>
Aug 26 13:17:43 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:17:43 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:17:43 user nova-compute[73503]:     </rng>
Aug 26 13:17:43 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:17:43 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:17:43 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:17:43 user nova-compute[73503]:     </memballoon>
Aug 26 13:17:43 user nova-compute[73503]:   </devices>
Aug 26 13:17:43 user nova-compute[73503]: </domain>
Aug 26 13:17:43 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1683915817',display_name='tempest-ServerActionsTestOtherA-server-537947146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1683915817',id=14,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FicSYtb+XZMerD16xYzO8q+U3g8rcG5d5MFbKomScizcC0+Fw0fIAVHBROQZJpRPR1Ifo9emWEM9YNTyE+juaAPyhTubC/2jYPI8N8OQIO3i32kDqa2jmMSSw5sG/yA==',key_name='tempest-keypair-1153890614',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-l71x2txa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:17:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ab4f580b-7abb-45b1-84fd-79957526124a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e31c21-13e7-46d1-9587-8464d14928eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:17:43 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5947525d-21, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5947525d-21, col_values=(('external_ids', {'iface-id': '5947525d-216d-4665-9d3c-b7c3deadfb70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:2f:32', 'vm-uuid': 'ab4f580b-7abb-45b1-84fd-79957526124a'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:43 user nova-compute[73503]: INFO os_vif [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21')
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6127d4f1-f61a-459d-8c71-4d3dcdf40484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84] added
Aug 26 13:17:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f56ee7-e511-443e-905f-421930c50527]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[38feaa30-c09b-4ad1-b4b0-adee9b9a393e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhbSkqZu {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No VIF found with MAC fa:16:3e:cc:2f:32, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhbSkqZu" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c3d7d-bac9-4f54-80db-a6c46c3021d1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhbSkqZu'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[887e3aea-5970-4de7-961b-c073327e5c3e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3fafa3-e4a3-4779-b313-3f00aa3a889e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[90314d02-b25f-4342-9169-00f728eea14a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]
Aug 26 13:17:43 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.
Aug 26 13:17:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4fae81-f23b-47e1-a4ab-808f70de6c12]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15ecf6-64ce-4ecb-aa8d-99c0a5aa75f9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:17:43 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:17:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837edb1-7477-44ce-b60b-d7dd10ebf5c2]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:17:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance destroyed successfully.
Aug 26 13:17:44 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.480s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== connect_volume: return (2112ms) {'type': 'block', 'scsi_wwn': '23035656662323061', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035656662323061', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:17:44 user nova-compute[73503]:   <uuid>11b30921-6ad1-4c04-8b5b-a98220732787</uuid>
Aug 26 13:17:44 user nova-compute[73503]:   <name>instance-00000005</name>
Aug 26 13:17:44 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:17:44 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:17:44 user nova-compute[73503]:   <metadata>
Aug 26 13:17:44 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:17:44 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:17:44 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherB-server-1082919212</nova:name>
Aug 26 13:17:44 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:17:42</nova:creationTime>
Aug 26 13:17:44 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:17:44 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:17:44 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:17:44 user nova-compute[73503]:       <nova:owner>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:user uuid="f9c0aa45010e48a0ba0082cfff7b2cc5">tempest-ServerActionsTestOtherB-100333381-project-member</nova:user>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:project uuid="0f45bb3c25384abfba41a5146a55a7e7">tempest-ServerActionsTestOtherB-100333381</nova:project>
Aug 26 13:17:44 user nova-compute[73503]:       </nova:owner>
Aug 26 13:17:44 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:17:44 user nova-compute[73503]:       <nova:ports>
Aug 26 13:17:44 user nova-compute[73503]:         <nova:port uuid="70726c37-f682-40cd-9155-843aca57acf4">
Aug 26 13:17:44 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:17:44 user nova-compute[73503]:         </nova:port>
Aug 26 13:17:44 user nova-compute[73503]:       </nova:ports>
Aug 26 13:17:44 user nova-compute[73503]:     </nova:instance>
Aug 26 13:17:44 user nova-compute[73503]:   </metadata>
Aug 26 13:17:44 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:17:44 user nova-compute[73503]:     <system>
Aug 26 13:17:44 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:17:44 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:17:44 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:17:44 user nova-compute[73503]:       <entry name="serial">11b30921-6ad1-4c04-8b5b-a98220732787</entry>
Aug 26 13:17:44 user nova-compute[73503]:       <entry name="uuid">11b30921-6ad1-4c04-8b5b-a98220732787</entry>
Aug 26 13:17:44 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:17:44 user nova-compute[73503]:     </system>
Aug 26 13:17:44 user nova-compute[73503]:   </sysinfo>
Aug 26 13:17:44 user nova-compute[73503]:   <os>
Aug 26 13:17:44 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:17:44 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:17:44 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:17:44 user nova-compute[73503]:   </os>
Aug 26 13:17:44 user nova-compute[73503]:   <features>
Aug 26 13:17:44 user nova-compute[73503]:     <acpi/>
Aug 26 13:17:44 user nova-compute[73503]:     <apic/>
Aug 26 13:17:44 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:17:44 user nova-compute[73503]:   </features>
Aug 26 13:17:44 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:17:44 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:17:44 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:17:44 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:17:44 user nova-compute[73503]:   </clock>
Aug 26 13:17:44 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:17:44 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:17:44 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:17:44 user nova-compute[73503]:   </cpu>
Aug 26 13:17:44 user nova-compute[73503]:   <devices>
Aug 26 13:17:44 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:17:44 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:17:44 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk"/>
Aug 26 13:17:44 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:17:44 user nova-compute[73503]:     </disk>
Aug 26 13:17:44 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:17:44 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:17:44 user nova-compute[73503]:       <source dev="/dev/sdf"/>
Aug 26 13:17:44 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:17:44 user nova-compute[73503]:       <serial>957d26ff-ff9f-404f-bd86-542b3fab7f84</serial>
Aug 26 13:17:44 user nova-compute[73503]:     </disk>
Aug 26 13:17:44 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:17:44 user nova-compute[73503]:       <mac address="fa:16:3e:c5:4c:46"/>
Aug 26 13:17:44 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:44 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:17:44 user nova-compute[73503]:       <target dev="tap70726c37-f6"/>
Aug 26 13:17:44 user nova-compute[73503]:     </interface>
Aug 26 13:17:44 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:17:44 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/console.log" append="off"/>
Aug 26 13:17:44 user nova-compute[73503]:     </serial>
Aug 26 13:17:44 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:17:44 user nova-compute[73503]:     <video>
Aug 26 13:17:44 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:17:44 user nova-compute[73503]:     </video>
Aug 26 13:17:44 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:17:44 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:17:44 user nova-compute[73503]:     </rng>
Aug 26 13:17:44 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:17:44 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:17:44 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:17:44 user nova-compute[73503]:     </memballoon>
Aug 26 13:17:44 user nova-compute[73503]:   </devices>
Aug 26 13:17:44 user nova-compute[73503]: </domain>
Aug 26 13:17:44 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG os_vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70726c37-f6, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70726c37-f6, col_values=(('external_ids', {'iface-id': '70726c37-f682-40cd-9155-843aca57acf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:4c:46', 'vm-uuid': '11b30921-6ad1-4c04-8b5b-a98220732787'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:17:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:44 user nova-compute[73503]: INFO os_vif [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6')
Aug 26 13:17:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-732c9ace-def6-44bd-84ef-0e2ffe5e6c10 req-b4682de1-00d9-4e75-9f50-82d16194fbb2 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-732c9ace-def6-44bd-84ef-0e2ffe5e6c10 req-b4682de1-00d9-4e75-9f50-82d16194fbb2 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-732c9ace-def6-44bd-84ef-0e2ffe5e6c10 req-b4682de1-00d9-4e75-9f50-82d16194fbb2 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-732c9ace-def6-44bd-84ef-0e2ffe5e6c10 req-b4682de1-00d9-4e75-9f50-82d16194fbb2 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-732c9ace-def6-44bd-84ef-0e2ffe5e6c10 req-b4682de1-00d9-4e75-9f50-82d16194fbb2 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:45 user nova-compute[73503]: WARNING nova.compute.manager [req-732c9ace-def6-44bd-84ef-0e2ffe5e6c10 req-b4682de1-00d9-4e75-9f50-82d16194fbb2 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:17:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:47 user nova-compute[73503]: WARNING nova.compute.manager [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 13:17:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:47 user nova-compute[73503]: WARNING nova.compute.manager [req-5718bdb0-cc57-4941-bee6-b5fa4f729237 req-3a069127-2713-435e-87c3-d0814a62ce0c service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 13:17:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-4fc13372-d64f-4626-9757-010de1f34398 req-99484fd0-e530-4a29-87f5-27f7c01d7a97 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4fc13372-d64f-4626-9757-010de1f34398 req-99484fd0-e530-4a29-87f5-27f7c01d7a97 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4fc13372-d64f-4626-9757-010de1f34398 req-99484fd0-e530-4a29-87f5-27f7c01d7a97 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4fc13372-d64f-4626-9757-010de1f34398 req-99484fd0-e530-4a29-87f5-27f7c01d7a97 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-4fc13372-d64f-4626-9757-010de1f34398 req-99484fd0-e530-4a29-87f5-27f7c01d7a97 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:48 user nova-compute[73503]: WARNING nova.compute.manager [req-4fc13372-d64f-4626-9757-010de1f34398 req-99484fd0-e530-4a29-87f5-27f7c01d7a97 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 13:17:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:49 user nova-compute[73503]: WARNING nova.compute.manager [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:17:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:49 user nova-compute[73503]: WARNING nova.compute.manager [req-936a68f7-fbb6-43a8-895b-c405c01f5002 req-be66777f-7ffd-4e85-935d-04294d06daf8 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:17:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055870.5562, ab4f580b-7abb-45b1-84fd-79957526124a => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:50 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] VM Resumed (Lifecycle Event)
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:17:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance spawned successfully.
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:17:50 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055870.5676007, ab4f580b-7abb-45b1-84fd-79957526124a => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:50 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] VM Started (Lifecycle Event)
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:50 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-348bfe9b-9ff5-45eb-85df-9f958f9e17cd req-2aa598a5-613f-4f87-86f5-17ccd7d3757f service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-348bfe9b-9ff5-45eb-85df-9f958f9e17cd req-2aa598a5-613f-4f87-86f5-17ccd7d3757f service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-348bfe9b-9ff5-45eb-85df-9f958f9e17cd req-2aa598a5-613f-4f87-86f5-17ccd7d3757f service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-348bfe9b-9ff5-45eb-85df-9f958f9e17cd req-2aa598a5-613f-4f87-86f5-17ccd7d3757f service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-348bfe9b-9ff5-45eb-85df-9f958f9e17cd req-2aa598a5-613f-4f87-86f5-17ccd7d3757f service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:17:50 user nova-compute[73503]: WARNING nova.compute.manager [req-348bfe9b-9ff5-45eb-85df-9f958f9e17cd req-2aa598a5-613f-4f87-86f5-17ccd7d3757f service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state resized and task_state resize_reverting.
Aug 26 13:17:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73503) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 13:17:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-08cb5630-2d77-4f5b-a597-be580abfc109 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 9a0a305a-0375-41a9-9b51-a78d65270f43 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055871.7456944, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Resumed (Lifecycle Event)
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-3ff995e8-ac7c-4164-bd77-4af904d56a11 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance running successfully.
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] finish_revert_migration finished successfully. {{(pid=73503) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055871.7473629, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Started (Lifecycle Event)
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055871.7582922, 11b30921-6ad1-4c04-8b5b-a98220732787 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Resumed (Lifecycle Event)
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 13:17:52 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055871.7584014, 11b30921-6ad1-4c04-8b5b-a98220732787 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:17:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Started (Lifecycle Event)
Aug 26 13:17:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:17:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:17:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 13:17:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b9baa392-76ef-490e-b480-2340f9a2761d tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance to original state: 'active'
Aug 26 13:17:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:17:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:00 user nova-compute[73503]: INFO nova.compute.manager [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Terminating instance
Aug 26 13:18:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-330ae88b-6b74-4d65-afb1-e5d0763b7a6c req-2904c568-09ac-4ffb-a55c-2716f3327eec service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-vif-unplugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-330ae88b-6b74-4d65-afb1-e5d0763b7a6c req-2904c568-09ac-4ffb-a55c-2716f3327eec service nova] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-330ae88b-6b74-4d65-afb1-e5d0763b7a6c req-2904c568-09ac-4ffb-a55c-2716f3327eec service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-330ae88b-6b74-4d65-afb1-e5d0763b7a6c req-2904c568-09ac-4ffb-a55c-2716f3327eec service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-330ae88b-6b74-4d65-afb1-e5d0763b7a6c req-2904c568-09ac-4ffb-a55c-2716f3327eec service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] No waiting events found dispatching network-vif-unplugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:18:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-330ae88b-6b74-4d65-afb1-e5d0763b7a6c req-2904c568-09ac-4ffb-a55c-2716f3327eec service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-vif-unplugged-adb80339-d391-4325-a8f9-f08a6a202667 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Instance destroyed successfully.
Aug 26 13:18:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lazy-loading 'resources' on Instance uuid 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-321211458',display_name='tempest-VolumesAdminNegativeTest-server-321211458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-321211458',id=7,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+ez0YIDNiNQoc2ie5SfikedQwmR0bMP3a85tEpo5nSQdhZAwXf7C5WRns0irk+RHp+45n5gWzZrBOnem+oNRZOwV80m8KETKblbaw/Yl1oV7H5mm8E8ZDrCXi/1KT2gQ==',key_name='tempest-keypair-315029503',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46148f4972634a4fbd1987020a7a5d85',ramdisk_id='',reservation_id='r-w2tpl0zz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-762845259',owner_user_name='tempest-VolumesAdminNegativeTest-762845259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:11:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e355237acb74d80b008f41672cea5d2',uuid=0afddfbd-234e-4ff0-9f88-35c7ee05d1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converting VIF {"id": "adb80339-d391-4325-a8f9-f08a6a202667", "address": "fa:16:3e:df:6d:0a", "network": {"id": "be11fe96-af43-4d9f-a84e-2d8d4b764500", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1144247395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46148f4972634a4fbd1987020a7a5d85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb80339-d3", "ovs_interfaceid": "adb80339-d391-4325-a8f9-f08a6a202667", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG os_vif [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadb80339-d3, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:01 user nova-compute[73503]: INFO os_vif [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6d:0a,bridge_name='br-int',has_traffic_filtering=True,id=adb80339-d391-4325-a8f9-f08a6a202667,network=Network(be11fe96-af43-4d9f-a84e-2d8d4b764500),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb80339-d3')
Aug 26 13:18:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Deleting instance files /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8_del
Aug 26 13:18:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Deletion of /opt/stack/data/nova/instances/0afddfbd-234e-4ff0-9f88-35c7ee05d1e8_del complete
Aug 26 13:18:01 user nova-compute[73503]: INFO nova.compute.manager [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 13:18:01 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:18:01 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:18:02 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Took 1.05 seconds to deallocate network for instance.
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6ee472-4594-4ad5-b64e-caa3aa23e8a3 req-1cb85670-752a-4bf0-bd40-8e9106702d63 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-vif-deleted-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:02 user nova-compute[73503]: INFO nova.compute.manager [req-0b6ee472-4594-4ad5-b64e-caa3aa23e8a3 req-1cb85670-752a-4bf0-bd40-8e9106702d63 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Neutron deleted interface adb80339-d391-4325-a8f9-f08a6a202667; detaching it from the instance and deleting it from the info cache
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-0b6ee472-4594-4ad5-b64e-caa3aa23e8a3 req-1cb85670-752a-4bf0-bd40-8e9106702d63 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b6ee472-4594-4ad5-b64e-caa3aa23e8a3 req-1cb85670-752a-4bf0-bd40-8e9106702d63 service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Detach interface failed, port_id=adb80339-d391-4325-a8f9-f08a6a202667, reason: Instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-adff29d7-7fa4-415f-8642-d1305ce1d884 req-34b8e8c1-9d94-4cb8-bcca-8458ce1112bd service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received event network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-adff29d7-7fa4-415f-8642-d1305ce1d884 req-34b8e8c1-9d94-4cb8-bcca-8458ce1112bd service nova] Acquiring lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-adff29d7-7fa4-415f-8642-d1305ce1d884 req-34b8e8c1-9d94-4cb8-bcca-8458ce1112bd service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-adff29d7-7fa4-415f-8642-d1305ce1d884 req-34b8e8c1-9d94-4cb8-bcca-8458ce1112bd service nova] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-adff29d7-7fa4-415f-8642-d1305ce1d884 req-34b8e8c1-9d94-4cb8-bcca-8458ce1112bd service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] No waiting events found dispatching network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:18:02 user nova-compute[73503]: WARNING nova.compute.manager [req-adff29d7-7fa4-415f-8642-d1305ce1d884 req-34b8e8c1-9d94-4cb8-bcca-8458ce1112bd service nova] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Received unexpected event network-vif-plugged-adb80339-d391-4325-a8f9-f08a6a202667 for instance with vm_state deleted and task_state None.
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:18:02 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:18:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:03 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Deleted allocations for instance 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8
Aug 26 13:18:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcceb722-a0f7-49f1-9207-d290eca66e1e tempest-VolumesAdminNegativeTest-762845259 tempest-VolumesAdminNegativeTest-762845259-project-member] Lock "0afddfbd-234e-4ff0-9f88-35c7ee05d1e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:03 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:18:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:06 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:08 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:08 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:09 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:14 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:18:14 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7053MB free_disk=25.401897430419922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ab4f580b-7abb-45b1-84fd-79957526124a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance de9a2cdb-bee4-4901-8dac-34ca47682cdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:18:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:16 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055881.2683034, 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:18:16 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] VM Stopped (Lifecycle Event)
Aug 26 13:18:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2fcf4436-d52a-4412-be04-0a39d7f61758 None None] [instance: 0afddfbd-234e-4ff0-9f88-35c7ee05d1e8] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:18:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:18:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-changed-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Refreshing instance network info cache due to event network-changed-d3dc7974-d54e-4973-948a-2097c25cb99a. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:18:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] Acquiring lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:18:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] Acquired lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:18:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Refreshing network info cache for port d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:18:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updated VIF entry in instance network info cache for port d3dc7974-d54e-4973-948a-2097c25cb99a. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:18:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updating instance_info_cache with network_info: [{"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:18:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b7e1b286-c9fd-4f0b-9580-0b74c2334c54 req-e6186832-d870-4c6c-beb7-fc0b7a0a3c09 service nova] Releasing lock "refresh_cache-5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:18:42 user nova-compute[73503]: INFO nova.compute.manager [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Rebuilding instance
Aug 26 13:18:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-eefb6bd5-80a1-4eb7-ac59-007ba2e2c545 req-a668e454-4f53-4112-afbc-649768f0946c service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-eefb6bd5-80a1-4eb7-ac59-007ba2e2c545 req-a668e454-4f53-4112-afbc-649768f0946c service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-eefb6bd5-80a1-4eb7-ac59-007ba2e2c545 req-a668e454-4f53-4112-afbc-649768f0946c service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-eefb6bd5-80a1-4eb7-ac59-007ba2e2c545 req-a668e454-4f53-4112-afbc-649768f0946c service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-eefb6bd5-80a1-4eb7-ac59-007ba2e2c545 req-a668e454-4f53-4112-afbc-649768f0946c service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:18:42 user nova-compute[73503]: WARNING nova.compute.manager [req-eefb6bd5-80a1-4eb7-ac59-007ba2e2c545 req-a668e454-4f53-4112-afbc-649768f0946c service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state rebuilding.
Aug 26 13:18:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance destroyed successfully.
Aug 26 13:18:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance destroyed successfully.
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-175016667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-834091793',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpgahKA8CJB13X+LFY/2mON6eWUOF6McKJjH37nhvAmdSCBwTfd3rM3EekabfFigEY0PKAbk6iHI/UNbfPhAHbso39f9MZDKm+ioagie1d7kHWpL+F+SHbQ5tSSQ5Zoxw==',key_name='tempest-keypair-596006166',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd48f06574c841cfbce3b3fbe9f18502',ramdisk_id='',reservation_id='r-p723fz9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-331387927',owner_user_name='tempest-ServerActionsV293TestJSON-331387927-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dbdc58b7f24255988b145cee0cdc15',uuid=5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converting VIF {"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3dc7974-d5, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:18:43 user nova-compute[73503]: INFO os_vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5')
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:18:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8932bad-3b7c-4ae2-9d55-b8637074fecd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea174eb-6c44-42e1-a442-a44ee799e315]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045aa830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eff50d-1557-4b59-ba96-93381bccb6c9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[31053e0c-7a3a-4720-ac33-68034364c621]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2128ec-6400-4f4a-ba76-57f0ed1a96d1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7718c2b3-4715-4b41-b005-56833777f52d]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7c277cc2', '/dev/disk/by-id/scsi-1SCST_BIO7c277cc2-4a7c3ee425d36ddd', '/dev/disk/by-id/scsi-23461376333656534') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a477ce35-d10f-4735-aa1d-618ad0417592]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db86122-7358-4a60-ac3f-ae8ef22573c0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07b334-646c-4384-850a-a734dbc9ac1a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]
Aug 26 13:18:43 user nova-compute[73503]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.
Aug 26 13:18:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[800a8c83-0f33-46c6-ad11-8272f4c81c6f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== disconnect_volume: return (355ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:18:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Deleting instance files /opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd_del
Aug 26 13:18:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Deletion of /opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd_del complete
Aug 26 13:18:43 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd could not be found.
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:18:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70fe694-4795-4bde-86d4-56a80da519a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[85adaf5e-ea0f-4b6a-893f-e618f466d935]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:18:43 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:18:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30435c8b0>, {}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Disconnecting from: [] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== disconnect_volume: return (70ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:18:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Preparing to wait for external event volume-reimaged-c26782a3-e1d2-47ad-ab79-2def94637c86 {{(pid=73503) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 13:18:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d731838-4875-462e-b377-7de4de7893db req-d55e83e6-9b15-407b-b592-e2e75e917f93 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d731838-4875-462e-b377-7de4de7893db req-d55e83e6-9b15-407b-b592-e2e75e917f93 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d731838-4875-462e-b377-7de4de7893db req-d55e83e6-9b15-407b-b592-e2e75e917f93 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d731838-4875-462e-b377-7de4de7893db req-d55e83e6-9b15-407b-b592-e2e75e917f93 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d731838-4875-462e-b377-7de4de7893db req-d55e83e6-9b15-407b-b592-e2e75e917f93 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No event matching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a in dict_keys([('volume-reimaged', 'c26782a3-e1d2-47ad-ab79-2def94637c86')]) {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 26 13:18:45 user nova-compute[73503]: WARNING nova.compute.manager [req-6d731838-4875-462e-b377-7de4de7893db req-d55e83e6-9b15-407b-b592-e2e75e917f93 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state rebuilding.
Aug 26 13:18:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:18:56 user nova-compute[73503]: INFO nova.compute.claims [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Claim successful on node user
Aug 26 13:18:56 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:18:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.policy [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8afe79d50d64cc3b087d5ecaacc66cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4179d75d5a49ffa8caae46f900f993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:18:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Creating image(s)
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "/opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "/opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk 1073741824" returned: 0 in 0.053s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:18:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Successfully created port: ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055923.0792766, 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:18:58 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] VM Stopped (Lifecycle Event)
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c35a6e18-64d0-437b-aecf-839804c82bfa None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Cannot resize image /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Ensure instance console log exists: /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Successfully updated port: ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquired lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-changed-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Refreshing instance network info cache due to event network-changed-ae2804bd-9d88-43ed-bb41-95ca9bbac159. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] Acquiring lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:18:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.neutron [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating instance_info_cache with network_info: [{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Releasing lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Instance network_info: |[{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] Acquired lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Refreshing network info cache for port ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Start _get_guest_xml network_info=[{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:18:59 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:18:59 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2055044220',display_name='tempest-TestStampPattern-server-2055044220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2055044220',id=19,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn2+pFLZ2VSZx7AckabSo562zlp19RUMBiOGyV73023vTl3GUKSePV72rfCWrRK/uBW0wHSSndFaIZ2aHgqtusbD669E0l1ESLIroNlZsjUuKyclKN2VYcnFWYA9yluhg==',key_name='tempest-TestStampPattern-764130994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4179d75d5a49ffa8caae46f900f993',ramdisk_id='',reservation_id='r-bh5uct02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-585487806',owner_user_name='tempest-TestStampPattern-585487806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:18:57Z,user_data=None,user_id='a8afe79d50d64cc3b087d5ecaacc66cb',uuid=6fb3f5db-a603-4982-8304-c4601a5c5b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converting VIF {"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fb3f5db-a603-4982-8304-c4601a5c5b17 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:18:59 user nova-compute[73503]:   <uuid>6fb3f5db-a603-4982-8304-c4601a5c5b17</uuid>
Aug 26 13:18:59 user nova-compute[73503]:   <name>instance-00000013</name>
Aug 26 13:18:59 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:18:59 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:18:59 user nova-compute[73503]:   <metadata>
Aug 26 13:18:59 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:18:59 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:18:59 user nova-compute[73503]:       <nova:name>tempest-TestStampPattern-server-2055044220</nova:name>
Aug 26 13:18:59 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:18:59</nova:creationTime>
Aug 26 13:18:59 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:18:59 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:18:59 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:18:59 user nova-compute[73503]:       <nova:owner>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:user uuid="a8afe79d50d64cc3b087d5ecaacc66cb">tempest-TestStampPattern-585487806-project-member</nova:user>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:project uuid="af4179d75d5a49ffa8caae46f900f993">tempest-TestStampPattern-585487806</nova:project>
Aug 26 13:18:59 user nova-compute[73503]:       </nova:owner>
Aug 26 13:18:59 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:18:59 user nova-compute[73503]:       <nova:ports>
Aug 26 13:18:59 user nova-compute[73503]:         <nova:port uuid="ae2804bd-9d88-43ed-bb41-95ca9bbac159">
Aug 26 13:18:59 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 13:18:59 user nova-compute[73503]:         </nova:port>
Aug 26 13:18:59 user nova-compute[73503]:       </nova:ports>
Aug 26 13:18:59 user nova-compute[73503]:     </nova:instance>
Aug 26 13:18:59 user nova-compute[73503]:   </metadata>
Aug 26 13:18:59 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:18:59 user nova-compute[73503]:     <system>
Aug 26 13:18:59 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:18:59 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:18:59 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:18:59 user nova-compute[73503]:       <entry name="serial">6fb3f5db-a603-4982-8304-c4601a5c5b17</entry>
Aug 26 13:18:59 user nova-compute[73503]:       <entry name="uuid">6fb3f5db-a603-4982-8304-c4601a5c5b17</entry>
Aug 26 13:18:59 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:18:59 user nova-compute[73503]:     </system>
Aug 26 13:18:59 user nova-compute[73503]:   </sysinfo>
Aug 26 13:18:59 user nova-compute[73503]:   <os>
Aug 26 13:18:59 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:18:59 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:18:59 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:18:59 user nova-compute[73503]:   </os>
Aug 26 13:18:59 user nova-compute[73503]:   <features>
Aug 26 13:18:59 user nova-compute[73503]:     <acpi/>
Aug 26 13:18:59 user nova-compute[73503]:     <apic/>
Aug 26 13:18:59 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:18:59 user nova-compute[73503]:   </features>
Aug 26 13:18:59 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:18:59 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:18:59 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:18:59 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:18:59 user nova-compute[73503]:   </clock>
Aug 26 13:18:59 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:18:59 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:18:59 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:18:59 user nova-compute[73503]:   </cpu>
Aug 26 13:18:59 user nova-compute[73503]:   <devices>
Aug 26 13:18:59 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:18:59 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:18:59 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk"/>
Aug 26 13:18:59 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:18:59 user nova-compute[73503]:     </disk>
Aug 26 13:18:59 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:18:59 user nova-compute[73503]:       <mac address="fa:16:3e:e2:79:e7"/>
Aug 26 13:18:59 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:18:59 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:18:59 user nova-compute[73503]:       <target dev="tapae2804bd-9d"/>
Aug 26 13:18:59 user nova-compute[73503]:     </interface>
Aug 26 13:18:59 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:18:59 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/console.log" append="off"/>
Aug 26 13:18:59 user nova-compute[73503]:     </serial>
Aug 26 13:18:59 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:18:59 user nova-compute[73503]:     <video>
Aug 26 13:18:59 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:18:59 user nova-compute[73503]:     </video>
Aug 26 13:18:59 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:18:59 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:18:59 user nova-compute[73503]:     </rng>
Aug 26 13:18:59 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:18:59 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:18:59 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:18:59 user nova-compute[73503]:     </memballoon>
Aug 26 13:18:59 user nova-compute[73503]:   </devices>
Aug 26 13:18:59 user nova-compute[73503]: </domain>
Aug 26 13:18:59 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2055044220',display_name='tempest-TestStampPattern-server-2055044220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2055044220',id=19,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn2+pFLZ2VSZx7AckabSo562zlp19RUMBiOGyV73023vTl3GUKSePV72rfCWrRK/uBW0wHSSndFaIZ2aHgqtusbD669E0l1ESLIroNlZsjUuKyclKN2VYcnFWYA9yluhg==',key_name='tempest-TestStampPattern-764130994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4179d75d5a49ffa8caae46f900f993',ramdisk_id='',reservation_id='r-bh5uct02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-585487806',owner_user_name='tempest-TestStampPattern-585487806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:18:57Z,user_data=None,user_id='a8afe79d50d64cc3b087d5ecaacc66cb',uuid=6fb3f5db-a603-4982-8304-c4601a5c5b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converting VIF {"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG os_vif [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2804bd-9d, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae2804bd-9d, col_values=(('external_ids', {'iface-id': 'ae2804bd-9d88-43ed-bb41-95ca9bbac159', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:79:e7', 'vm-uuid': '6fb3f5db-a603-4982-8304-c4601a5c5b17'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:18:59 user nova-compute[73503]: INFO os_vif [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d')
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No VIF found with MAC fa:16:3e:e2:79:e7, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updated VIF entry in instance network info cache for port ae2804bd-9d88-43ed-bb41-95ca9bbac159. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG nova.network.neutron [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating instance_info_cache with network_info: [{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c4129397-2188-405e-967f-59eeea8d1fac req-bd7d7346-8c54-45ac-b9d3-dbe7bae4f02e service nova] Releasing lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:18:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-f329114f-3528-4c0a-9bca-5b02ed81afb9 req-33f31612-5170-4694-a92f-a4e3bc990366 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f329114f-3528-4c0a-9bca-5b02ed81afb9 req-33f31612-5170-4694-a92f-a4e3bc990366 service nova] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f329114f-3528-4c0a-9bca-5b02ed81afb9 req-33f31612-5170-4694-a92f-a4e3bc990366 service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f329114f-3528-4c0a-9bca-5b02ed81afb9 req-33f31612-5170-4694-a92f-a4e3bc990366 service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-f329114f-3528-4c0a-9bca-5b02ed81afb9 req-33f31612-5170-4694-a92f-a4e3bc990366 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] No waiting events found dispatching network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:00 user nova-compute[73503]: WARNING nova.compute.manager [req-f329114f-3528-4c0a-9bca-5b02ed81afb9 req-33f31612-5170-4694-a92f-a4e3bc990366 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received unexpected event network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 for instance with vm_state building and task_state spawning.
Aug 26 13:19:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-ce9f3413-c689-4c8e-b41b-8c8f0ace2fe1 req-766630f8-76d2-4552-a5ce-a302a50f4d8b service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ce9f3413-c689-4c8e-b41b-8c8f0ace2fe1 req-766630f8-76d2-4552-a5ce-a302a50f4d8b service nova] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ce9f3413-c689-4c8e-b41b-8c8f0ace2fe1 req-766630f8-76d2-4552-a5ce-a302a50f4d8b service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ce9f3413-c689-4c8e-b41b-8c8f0ace2fe1 req-766630f8-76d2-4552-a5ce-a302a50f4d8b service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-ce9f3413-c689-4c8e-b41b-8c8f0ace2fe1 req-766630f8-76d2-4552-a5ce-a302a50f4d8b service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] No waiting events found dispatching network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:03 user nova-compute[73503]: WARNING nova.compute.manager [req-ce9f3413-c689-4c8e-b41b-8c8f0ace2fe1 req-766630f8-76d2-4552-a5ce-a302a50f4d8b service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received unexpected event network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 for instance with vm_state building and task_state spawning.
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055943.4267824, 6fb3f5db-a603-4982-8304-c4601a5c5b17 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] VM Resumed (Lifecycle Event)
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Instance spawned successfully.
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055943.4283812, 6fb3f5db-a603-4982-8304-c4601a5c5b17 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] VM Started (Lifecycle Event)
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 26 13:19:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:03 user nova-compute[73503]: INFO nova.compute.manager [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Took 7.13 seconds to build instance.
Aug 26 13:19:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-327f7450-428e-46d7-b78f-67196705347f tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.234s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-changed-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Refreshing instance network info cache due to event network-changed-5bf4353b-4c31-4fe2-928b-b765212e20d5. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG nova.network.neutron [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Refreshing network info cache for port 5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 req-9bba376c-5c07-465e-911f-938b1d1fdfe3 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event volume-reimaged-c26782a3-e1d2-47ad-ab79-2def94637c86 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 req-9bba376c-5c07-465e-911f-938b1d1fdfe3 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 req-9bba376c-5c07-465e-911f-938b1d1fdfe3 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 req-9bba376c-5c07-465e-911f-938b1d1fdfe3 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 req-9bba376c-5c07-465e-911f-938b1d1fdfe3 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Processing event volume-reimaged-c26782a3-e1d2-47ad-ab79-2def94637c86 {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 13:19:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance event wait completed in 22 seconds for volume-reimaged {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:19:08 user nova-compute[73503]: INFO nova.virt.block_device [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Booting with volume c26782a3-e1d2-47ad-ab79-2def94637c86 at /dev/vda
Aug 26 13:19:08 user nova-compute[73503]: DEBUG os_brick.utils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b13e94d-fe6f-4614-a150-3e854c8ed319]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2b54f9-f030-4fe4-a681-43c84520ad11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5f9ec0-513d-4d6c-87f2-91c6bd994eb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36bd611-5fb0-40e0-9f03-c07d35c38788]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:19:08 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e9cb9b-ed75-4cd8-937c-ba7672a97adf]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG nova.network.neutron [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updated VIF entry in instance network info cache for port 5bf4353b-4c31-4fe2-928b-b765212e20d5. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG nova.network.neutron [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG os_brick.utils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updating existing volume attachment record: 0e749a1d-b9e5-42c1-97b0-69103b35cf67 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:19:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-98d35471-2375-4186-85df-09647f84bf45 req-da5910c8-71e2-481d-be6c-b54a77196874 service nova] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-changed-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing instance network info cache due to event network-changed-896211ce-9a81-4323-9603-1c68cfbef56a. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] Acquiring lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] Acquired lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Refreshing network info cache for port 896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:19:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updated VIF entry in instance network info cache for port 896211ce-9a81-4323-9603-1c68cfbef56a. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-31cff8e0-01c1-4d42-b374-bc1d0596c8dc req-f310cd96-41c2-476d-9694-5051441e9179 service nova] Releasing lock "refresh_cache-acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:19:11 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:12 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:13 user nova-compute[73503]: INFO nova.compute.manager [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Terminating instance
Aug 26 13:19:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-120d04c3-d858-41b9-988b-52e98a672958 req-4765953c-c510-4dee-bcd8-e1017741e5a2 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-120d04c3-d858-41b9-988b-52e98a672958 req-4765953c-c510-4dee-bcd8-e1017741e5a2 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-120d04c3-d858-41b9-988b-52e98a672958 req-4765953c-c510-4dee-bcd8-e1017741e5a2 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-120d04c3-d858-41b9-988b-52e98a672958 req-4765953c-c510-4dee-bcd8-e1017741e5a2 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-120d04c3-d858-41b9-988b-52e98a672958 req-4765953c-c510-4dee-bcd8-e1017741e5a2 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-120d04c3-d858-41b9-988b-52e98a672958 req-4765953c-c510-4dee-bcd8-e1017741e5a2 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-896211ce-9a81-4323-9603-1c68cfbef56a for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:13 user nova-compute[73503]: INFO nova.compute.manager [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Shelving
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance destroyed successfully.
Aug 26 13:19:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Beginning cold snapshot process
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Instance destroyed successfully.
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.objects.instance [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lazy-loading 'resources' on Instance uuid acf6501e-5c82-4c7d-a76a-d0a1b8c5305f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896211ce-9a, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk /opt/stack/data/nova/instances/snapshots/tmptk758v2i/f109c34a3fca4500aef2dcbf8406cb3d {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:ed:6f,bridge_name='br-int',has_traffic_filtering=True,id=896211ce-9a81-4323-9603-1c68cfbef56a,network=Network(7f0c9c89-83f2-41a1-8437-ed558f6d9117),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896211ce-9a')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbf77752-f9, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6a:48,bridge_name='br-int',has_traffic_filtering=True,id=bbf77752-f982-43cd-baf6-b77c4a13f45d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbbf77752-f9')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f7e8485-0e, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: WARNING nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-896211ce-9a81-4323-9603-1c68cfbef56a for instance with vm_state active and task_state deleting.
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-bbf77752-f982-43cd-baf6-b77c4a13f45d for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: WARNING nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-bbf77752-f982-43cd-baf6-b77c4a13f45d for instance with vm_state active and task_state deleting.
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: WARNING nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-ced8d9ae-9851-42ac-8559-9fba5c700ff2 for instance with vm_state active and task_state deleting.
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-0ef76712-0557-4507-9aa5-9b06e55c423d for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: WARNING nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-0ef76712-0557-4507-9aa5-9b06e55c423d for instance with vm_state active and task_state deleting.
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-62dd28c8-42c4-433f-85f5-7be8c1dc4b3f req-d1a64ba4-ed36-4052-a6a0-a1597f3a6c30 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-053a58c2-c89d-4117-8365-8a96922238ab for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b8:e8,bridge_name='br-int',has_traffic_filtering=True,id=9f7e8485-0e8a-4eb1-bcb5-097e287b2878,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f7e8485-0e')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapced8d9ae-98, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:1b,bridge_name='br-int',has_traffic_filtering=True,id=ced8d9ae-9851-42ac-8559-9fba5c700ff2,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapced8d9ae-98')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ef76712-05, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:20:98,bridge_name='br-int',has_traffic_filtering=True,id=0ef76712-0557-4507-9aa5-9b06e55c423d,network=Network(930799b8-d9ca-4ad4-820e-ca437cfc9404),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ef76712-05')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap053a58c2-c8, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:c9:32,bridge_name='br-int',has_traffic_filtering=True,id=053a58c2-c89d-4117-8365-8a96922238ab,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053a58c2-c8')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:16:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1302237439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1302237439',id=15,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDopTWZv3i47LWr1ot9qoQL4VqGk5lZzwzAp9ZCFpXbwtFOy5gKIVuH/V2fHQXcvX2T/8yNrNoA/FgwP+KoNuHaIZ0PFzGgteY6Ffhb00/tHPkgtqTFg2n7qZVU62K7xGA==',key_name='tempest-keypair-762314645',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='673f05654a4d491eb5cc315db2b77f9f',ramdisk_id='',reservation_id='r-dye4bujf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1198062199',owner_user_name='tempest-TaggedBootDevicesTest_v242-1198062199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e8a8301938e410c81a2ded0c8e38321',uuid=acf6501e-5c82-4c7d-a76a-d0a1b8c5305f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converting VIF {"id": "17a04c8d-f1de-46a2-90f3-11f710099890", "address": "fa:16:3e:0e:5e:2f", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a04c8d-f1", "ovs_interfaceid": "17a04c8d-f1de-46a2-90f3-11f710099890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17a04c8d-f1, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:15 user nova-compute[73503]: INFO os_vif [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5e:2f,bridge_name='br-int',has_traffic_filtering=True,id=17a04c8d-f1de-46a2-90f3-11f710099890,network=Network(d5ffd9f6-7d48-4681-8ff6-099d2c809660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a04c8d-f1')
Aug 26 13:19:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hqevtWPA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:19:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a7d162-ec2c-488b-980b-15f544ebc223]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4188c524-118b-4784-bd08-54e5937e4dc4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30442b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c'): ({'sdg'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Removing single pathed devices sdg {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7e3758-75c8-420c-aa5a-4542a5ad0f22]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[967fc0c4-fc98-4091-a0d2-8b1cedb30d56]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Flushing IO for device /dev/sdg {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e247b-b470-48c5-9b7f-9be3665fa882]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ae7dcd-5531-401d-a1a6-bd730f24107b]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] SCSI volumes sdg have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72311556-a467-4647-a7e6-c8b42ba4e681]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk /opt/stack/data/nova/instances/snapshots/tmptk758v2i/f109c34a3fca4500aef2dcbf8406cb3d" returned: 0 in 0.907s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Snapshot extracted, beginning image upload
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[912c8047-1d56-4755-93b0-1c428038e2a5]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260]
Aug 26 13:19:16 user nova-compute[73503]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c, portal: 172.16.0.220,3260] successful.
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44e2ba01-0b10-486d-94e6-be34c36bb88c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cba11fe-c799-48d4-b394-73772b6b9982]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== disconnect_volume: return (350ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UZrfDCye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:19:16 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6433d40-dfeb-40c7-b7c4-368616187455]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[90311ff2-afa0-4953-a8d7-0fb80246e7fa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3043832e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9382641-a46d-433f-85b4-716cbb76b817]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed35001-23bc-4db1-bbe9-2367fc7ebab8]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4dd20-8b8c-4cd9-9edf-095622f2de7b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6cabc-8656-4575-a264-e7f647206363]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f390ad87-a68f-4e78-a69b-808663d649a8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695f085-73d6-456e-8c7b-7bafaf7c6adc]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260]
Aug 26 13:19:16 user nova-compute[73503]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce, portal: 172.16.0.220,3260] successful.
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b63d608a-d45e-4aca-ada0-9d8753daf8ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4356b368-69d9-4c57-b2cc-b9481adf7495]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== disconnect_volume: return (359ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NxTyjXvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:19:16 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e9494b-d923-464b-b3b9-58633a33dfe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa766f1-f29c-4cbc-8f88-db5180c1679f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:16 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30459e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3'): ({'sdd'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Removing single pathed devices sdd {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab4e796-d43e-40d4-8914-ce94af899787]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6802552c-367d-4633-b03b-57a6f8b8cbe4]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Flushing IO for device /dev/sdd {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4858cb-16f3-42cd-a458-cd0f2dcca1c0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4777571c-e61a-4b05-a69c-165c6a1d24a3]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dfe845-8fb6-4d94-9a7c-0802f38fad7a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8ceff6-f034-45c0-b81b-0d819892f55a]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260]
Aug 26 13:19:16 user nova-compute[73503]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3, portal: 172.16.0.220,3260] successful.
Aug 26 13:19:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e49b9918-7c9f-4c7a-88ce-96c07a32aff3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a8797-a00e-4d81-aea3-c9ac5de0f335]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] <== disconnect_volume: return (345ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:19:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Deleting instance files /opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f_del
Aug 26 13:19:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Deletion of /opt/stack/data/nova/instances/acf6501e-5c82-4c7d-a76a-d0a1b8c5305f_del complete
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:17 user nova-compute[73503]: INFO nova.compute.manager [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Took 4.09 seconds to destroy the instance on the hypervisor.
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-2f94395e-899b-435b-a6a1-da59d9253384 req-1f3bc39b-3248-440f-8593-a5310d276875 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2f94395e-899b-435b-a6a1-da59d9253384 req-1f3bc39b-3248-440f-8593-a5310d276875 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2f94395e-899b-435b-a6a1-da59d9253384 req-1f3bc39b-3248-440f-8593-a5310d276875 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2f94395e-899b-435b-a6a1-da59d9253384 req-1f3bc39b-3248-440f-8593-a5310d276875 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-2f94395e-899b-435b-a6a1-da59d9253384 req-1f3bc39b-3248-440f-8593-a5310d276875 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-2f94395e-899b-435b-a6a1-da59d9253384 req-1f3bc39b-3248-440f-8593-a5310d276875 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-1380998f-b789-4d3f-8494-a73674bf186e req-8cfd7c0f-a708-4e56-bbfa-3cd984c32481 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1380998f-b789-4d3f-8494-a73674bf186e req-8cfd7c0f-a708-4e56-bbfa-3cd984c32481 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1380998f-b789-4d3f-8494-a73674bf186e req-8cfd7c0f-a708-4e56-bbfa-3cd984c32481 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1380998f-b789-4d3f-8494-a73674bf186e req-8cfd7c0f-a708-4e56-bbfa-3cd984c32481 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-1380998f-b789-4d3f-8494-a73674bf186e req-8cfd7c0f-a708-4e56-bbfa-3cd984c32481 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:17 user nova-compute[73503]: WARNING nova.compute.manager [req-1380998f-b789-4d3f-8494-a73674bf186e req-8cfd7c0f-a708-4e56-bbfa-3cd984c32481 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-053a58c2-c89d-4117-8365-8a96922238ab for instance with vm_state active and task_state deleting.
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd/disk --force-share --output=json" returned: 0 in 0.441s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7269MB free_disk=25.38666534423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Snapshot image upload complete
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 950df9cd-10d7-45cb-9714-9ee01f508acd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ab4f580b-7abb-45b1-84fd-79957526124a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 11b30921-6ad1-4c04-8b5b-a98220732787 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance de9a2cdb-bee4-4901-8dac-34ca47682cdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:19:19 user nova-compute[73503]: INFO nova.compute.manager [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Shelve offloading
Aug 26 13:19:19 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance destroyed successfully.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-9f7e8485-0e8a-4eb1-bcb5-097e287b2878 for instance with vm_state active and task_state deleting.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved and task_state shelving_offloading.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved and task_state shelving_offloading.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-unplugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-unplugged-17a04c8d-f1de-46a2-90f3-11f710099890 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] No waiting events found dispatching network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received unexpected event network-vif-plugged-17a04c8d-f1de-46a2-90f3-11f710099890 for instance with vm_state active and task_state deleting.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved and task_state shelving_offloading.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved and task_state shelving_offloading.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved and task_state shelving_offloading.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:19 user nova-compute[73503]: WARNING nova.compute.manager [req-6ae3e716-b513-4c53-8d56-0c2443fbbf53 req-d00a61a6-5223-4d64-871c-e73f18101478 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved and task_state shelving_offloading.
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:19:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-f82cc5ab-e12d-40ed-ad5e-defe41ae21d1 req-645be255-835e-4244-a4ee-975a5167e1b8 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-deleted-17a04c8d-f1de-46a2-90f3-11f710099890 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:21 user nova-compute[73503]: INFO nova.compute.manager [req-f82cc5ab-e12d-40ed-ad5e-defe41ae21d1 req-645be255-835e-4244-a4ee-975a5167e1b8 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Neutron deleted interface 17a04c8d-f1de-46a2-90f3-11f710099890; detaching it from the instance and deleting it from the info cache
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.network.neutron [req-f82cc5ab-e12d-40ed-ad5e-defe41ae21d1 req-645be255-835e-4244-a4ee-975a5167e1b8 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "address": "fa:16:3e:a5:27:1b", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapced8d9ae-98", "ovs_interfaceid": "ced8d9ae-9851-42ac-8559-9fba5c700ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-f82cc5ab-e12d-40ed-ad5e-defe41ae21d1 req-645be255-835e-4244-a4ee-975a5167e1b8 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Detach interface failed, port_id=17a04c8d-f1de-46a2-90f3-11f710099890, reason: Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:19:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Creating image(s)
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Ensure instance console log exists: /opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Start _get_guest_xml network_info=[{"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c26782a3-e1d2-47ad-ab79-2def94637c86', 'serial': 'c26782a3-e1d2-47ad-ab79-2def94637c86'}, 'attachment_id': '0e749a1d-b9e5-42c1-97b0-69103b35cf67', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:19:21 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 13:19:21 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:19:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:19:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:19:21 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8090a8e-f55e-4c23-91c1-56b8e371f411]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:19:21 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1108ae-3f4d-4eaa-928b-2783b5aa7ca4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86] added
Aug 26 13:19:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbb92d8-9044-46ac-b280-c0fb4fb27320]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83054bcf-2a64-4e7c-92cc-585027cb5e67]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFTeqRxN {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFTeqRxN" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f92fd-352c-4a36-9d6a-107f3ee2eb25]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFTeqRxN'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283fa91-6be0-44ea-9f9f-be9b72d4ec6c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861dca9-87e6-4502-b1f7-0ef78f4ff65a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:21 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:21 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:19:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb1314e-5617-49ac-80e9-8f66cbfcf248]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]
Aug 26 13:19:22 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.
Aug 26 13:19:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21694342-c1b2-49f0-b30b-6f8d5b858c16]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[316aa9ce-1a15-4dae-9163-3a12411a748d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:22 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:22 user nova-compute[73503]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:19:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:19:22 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:19:22 user nova-compute[73503]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:19:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e43f3-bcb3-4bd8-8446-892f1391961f]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance destroyed successfully.
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'resources' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1766659861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1766659861',id=17,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENbUsg30RJnWfw6ueTNmDdKUgT/miUT88A3J6urec/DWGrmHyoXfCoNZLgKuV23u9OFYA3ebJdjZf8D8TeMUNIFTmyK3Ijmasq5/b+dFhAXAvLqzisTxs7nsKcHbpRgKQ==',key_name='tempest-keypair-1321173568',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-jthfuhzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member',shelved_at='2023-08-26T13:19:19.529522',shelved_host='user',shelved_image_id='1ce19902-5575-4e90-a163-1f7fb0151786'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=de9a2cdb-bee4-4901-8dac-34ca47682cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG os_vif [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bf4353b-4c, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:22 user nova-compute[73503]: INFO os_vif [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c')
Aug 26 13:19:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Deleting instance files /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf_del
Aug 26 13:19:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Deletion of /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf_del complete
Aug 26 13:19:22 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Deleted allocations for instance de9a2cdb-bee4-4901-8dac-34ca47682cdf
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'numa_topology' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.objects.base [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<de9a2cdb-bee4-4901-8dac-34ca47682cdf> lazy-loaded attributes: resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:19:22 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8c42f7b3-1759-471c-be38-466d12f7633e tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.505s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23461376333656534', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461376333656534', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-175016667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-834091793',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpgahKA8CJB13X+LFY/2mON6eWUOF6McKJjH37nhvAmdSCBwTfd3rM3EekabfFigEY0PKAbk6iHI/UNbfPhAHbso39f9MZDKm+ioagie1d7kHWpL+F+SHbQ5tSSQ5Zoxw==',key_name='tempest-keypair-596006166',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd48f06574c841cfbce3b3fbe9f18502',ramdisk_id='',reservation_id='r-p723fz9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-331387927',owner_user_name='tempest-ServerActionsV293TestJSON-331387927-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dbdc58b7f24255988b145cee0cdc15',uuid=5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converting VIF {"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:19:23 user nova-compute[73503]:   <uuid>5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd</uuid>
Aug 26 13:19:23 user nova-compute[73503]:   <name>instance-00000010</name>
Aug 26 13:19:23 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:19:23 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:19:23 user nova-compute[73503]:   <metadata>
Aug 26 13:19:23 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:19:23 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:19:23 user nova-compute[73503]:       <nova:name>tempest-ServerActionsV293TestJSON-server-175016667</nova:name>
Aug 26 13:19:23 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:19:21</nova:creationTime>
Aug 26 13:19:23 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:19:23 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:19:23 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:19:23 user nova-compute[73503]:       <nova:owner>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:user uuid="29dbdc58b7f24255988b145cee0cdc15">tempest-ServerActionsV293TestJSON-331387927-project-member</nova:user>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:project uuid="dd48f06574c841cfbce3b3fbe9f18502">tempest-ServerActionsV293TestJSON-331387927</nova:project>
Aug 26 13:19:23 user nova-compute[73503]:       </nova:owner>
Aug 26 13:19:23 user nova-compute[73503]:       <nova:ports>
Aug 26 13:19:23 user nova-compute[73503]:         <nova:port uuid="d3dc7974-d54e-4973-948a-2097c25cb99a">
Aug 26 13:19:23 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:19:23 user nova-compute[73503]:         </nova:port>
Aug 26 13:19:23 user nova-compute[73503]:       </nova:ports>
Aug 26 13:19:23 user nova-compute[73503]:     </nova:instance>
Aug 26 13:19:23 user nova-compute[73503]:   </metadata>
Aug 26 13:19:23 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:19:23 user nova-compute[73503]:     <system>
Aug 26 13:19:23 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:19:23 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:19:23 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:19:23 user nova-compute[73503]:       <entry name="serial">5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd</entry>
Aug 26 13:19:23 user nova-compute[73503]:       <entry name="uuid">5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd</entry>
Aug 26 13:19:23 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:19:23 user nova-compute[73503]:     </system>
Aug 26 13:19:23 user nova-compute[73503]:   </sysinfo>
Aug 26 13:19:23 user nova-compute[73503]:   <os>
Aug 26 13:19:23 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:19:23 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:19:23 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:19:23 user nova-compute[73503]:   </os>
Aug 26 13:19:23 user nova-compute[73503]:   <features>
Aug 26 13:19:23 user nova-compute[73503]:     <acpi/>
Aug 26 13:19:23 user nova-compute[73503]:     <apic/>
Aug 26 13:19:23 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:19:23 user nova-compute[73503]:   </features>
Aug 26 13:19:23 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:19:23 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:19:23 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:19:23 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:19:23 user nova-compute[73503]:   </clock>
Aug 26 13:19:23 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:19:23 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:19:23 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:19:23 user nova-compute[73503]:   </cpu>
Aug 26 13:19:23 user nova-compute[73503]:   <devices>
Aug 26 13:19:23 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:19:23 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:19:23 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:19:23 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:19:23 user nova-compute[73503]:       <serial>c26782a3-e1d2-47ad-ab79-2def94637c86</serial>
Aug 26 13:19:23 user nova-compute[73503]:     </disk>
Aug 26 13:19:23 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:19:23 user nova-compute[73503]:       <mac address="fa:16:3e:7f:54:9d"/>
Aug 26 13:19:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:19:23 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:19:23 user nova-compute[73503]:       <target dev="tapd3dc7974-d5"/>
Aug 26 13:19:23 user nova-compute[73503]:     </interface>
Aug 26 13:19:23 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:19:23 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd/console.log" append="off"/>
Aug 26 13:19:23 user nova-compute[73503]:     </serial>
Aug 26 13:19:23 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:19:23 user nova-compute[73503]:     <video>
Aug 26 13:19:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:19:23 user nova-compute[73503]:     </video>
Aug 26 13:19:23 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:19:23 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:19:23 user nova-compute[73503]:     </rng>
Aug 26 13:19:23 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:19:23 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:19:23 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:19:23 user nova-compute[73503]:     </memballoon>
Aug 26 13:19:23 user nova-compute[73503]:   </devices>
Aug 26 13:19:23 user nova-compute[73503]: </domain>
Aug 26 13:19:23 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-175016667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-834091793',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpgahKA8CJB13X+LFY/2mON6eWUOF6McKJjH37nhvAmdSCBwTfd3rM3EekabfFigEY0PKAbk6iHI/UNbfPhAHbso39f9MZDKm+ioagie1d7kHWpL+F+SHbQ5tSSQ5Zoxw==',key_name='tempest-keypair-596006166',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dd48f06574c841cfbce3b3fbe9f18502',ramdisk_id='',reservation_id='r-p723fz9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-331387927',owner_user_name='tempest-ServerActionsV293TestJSON-331387927-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dbdc58b7f24255988b145cee0cdc15',uuid=5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converting VIF {"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG os_vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3dc7974-d5, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3dc7974-d5, col_values=(('external_ids', {'iface-id': 'd3dc7974-d54e-4973-948a-2097c25cb99a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:54:9d', 'vm-uuid': '5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:23 user nova-compute[73503]: INFO os_vif [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5')
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] No VIF found with MAC fa:16:3e:7f:54:9d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-f7efebf6-01e1-4716-ba0b-d7f74684e895 req-6ee27514-cd09-4759-9f92-61fbe3c84b49 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-deleted-ced8d9ae-9851-42ac-8559-9fba5c700ff2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:23 user nova-compute[73503]: INFO nova.compute.manager [req-f7efebf6-01e1-4716-ba0b-d7f74684e895 req-6ee27514-cd09-4759-9f92-61fbe3c84b49 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Neutron deleted interface ced8d9ae-9851-42ac-8559-9fba5c700ff2; detaching it from the instance and deleting it from the info cache
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.network.neutron [req-f7efebf6-01e1-4716-ba0b-d7f74684e895 req-6ee27514-cd09-4759-9f92-61fbe3c84b49 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053a58c2-c89d-4117-8365-8a96922238ab", "address": "fa:16:3e:66:c9:32", "network": {"id": "d5ffd9f6-7d48-4681-8ff6-099d2c809660", "bridge": "br-int", "label": "tempest-device-tagging-net2-252214038", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053a58c2-c8", "ovs_interfaceid": "053a58c2-c89d-4117-8365-8a96922238ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-f7efebf6-01e1-4716-ba0b-d7f74684e895 req-6ee27514-cd09-4759-9f92-61fbe3c84b49 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Detach interface failed, port_id=ced8d9ae-9851-42ac-8559-9fba5c700ff2, reason: Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:24 user nova-compute[73503]: INFO nova.compute.manager [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] instance snapshotting
Aug 26 13:19:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Beginning live snapshot process
Aug 26 13:19:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-0abd2ebd-f9be-4b96-bcbb-f0118bf3ea83 req-90e0129c-af6b-484f-a0f1-caa40f31a133 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0abd2ebd-f9be-4b96-bcbb-f0118bf3ea83 req-90e0129c-af6b-484f-a0f1-caa40f31a133 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0abd2ebd-f9be-4b96-bcbb-f0118bf3ea83 req-90e0129c-af6b-484f-a0f1-caa40f31a133 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0abd2ebd-f9be-4b96-bcbb-f0118bf3ea83 req-90e0129c-af6b-484f-a0f1-caa40f31a133 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-0abd2ebd-f9be-4b96-bcbb-f0118bf3ea83 req-90e0129c-af6b-484f-a0f1-caa40f31a133 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:24 user nova-compute[73503]: WARNING nova.compute.manager [req-0abd2ebd-f9be-4b96-bcbb-f0118bf3ea83 req-90e0129c-af6b-484f-a0f1-caa40f31a133 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state rebuild_spawning.
Aug 26 13:19:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-deleted-053a58c2-c89d-4117-8365-8a96922238ab {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:25 user nova-compute[73503]: INFO nova.compute.manager [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Neutron deleted interface 053a58c2-c89d-4117-8365-8a96922238ab; detaching it from the instance and deleting it from the info cache
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "896211ce-9a81-4323-9603-1c68cfbef56a", "address": "fa:16:3e:81:ed:6f", "network": {"id": "7f0c9c89-83f2-41a1-8437-ed558f6d9117", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1493041289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896211ce-9a", "ovs_interfaceid": "896211ce-9a81-4323-9603-1c68cfbef56a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:25 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Took 8.26 seconds to deallocate network for instance.
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Detach interface failed, port_id=053a58c2-c89d-4117-8365-8a96922238ab, reason: Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-deleted-896211ce-9a81-4323-9603-1c68cfbef56a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:25 user nova-compute[73503]: INFO nova.compute.manager [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Neutron deleted interface 896211ce-9a81-4323-9603-1c68cfbef56a; detaching it from the instance and deleting it from the info cache
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0ef76712-0557-4507-9aa5-9b06e55c423d", "address": "fa:16:3e:96:20:98", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.68", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ef76712-05", "ovs_interfaceid": "0ef76712-0557-4507-9aa5-9b06e55c423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt02ij9o_/b360441624c34448a640febf260e3e15.delta 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e66e5b38-3dda-461c-a82c-2e3e579cd2a9 req-61416dfd-3486-463c-9087-5813a369fe61 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Detach interface failed, port_id=896211ce-9a81-4323-9603-1c68cfbef56a, reason: Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:19:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt02ij9o_/b360441624c34448a640febf260e3e15.delta 1073741824" returned: 0 in 0.060s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 13:19:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:19:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:19:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 13:19:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-ef0098a5-2a48-4457-9eb8-e712386ad128 req-021a46a3-3a38-41f3-855f-b2513957e58b service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef0098a5-2a48-4457-9eb8-e712386ad128 req-021a46a3-3a38-41f3-855f-b2513957e58b service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef0098a5-2a48-4457-9eb8-e712386ad128 req-021a46a3-3a38-41f3-855f-b2513957e58b service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef0098a5-2a48-4457-9eb8-e712386ad128 req-021a46a3-3a38-41f3-855f-b2513957e58b service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-ef0098a5-2a48-4457-9eb8-e712386ad128 req-021a46a3-3a38-41f3-855f-b2513957e58b service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:26 user nova-compute[73503]: WARNING nova.compute.manager [req-ef0098a5-2a48-4457-9eb8-e712386ad128 req-021a46a3-3a38-41f3-855f-b2513957e58b service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state rebuild_spawning.
Aug 26 13:19:26 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:19:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt02ij9o_/b360441624c34448a640febf260e3e15.delta /opt/stack/data/nova/instances/snapshots/tmpt02ij9o_/b360441624c34448a640febf260e3e15 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055967.3675208, 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] VM Resumed (Lifecycle Event)
Aug 26 13:19:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt02ij9o_/b360441624c34448a640febf260e3e15.delta /opt/stack/data/nova/instances/snapshots/tmpt02ij9o_/b360441624c34448a640febf260e3e15" returned: 0 in 0.473s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Snapshot extracted, beginning image upload
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-fdbaddfd-a556-4483-9bc2-b403fe8ed1b5 req-0e771557-045b-4c72-8b78-131237a7f1d5 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Received event network-vif-deleted-0ef76712-0557-4507-9aa5-9b06e55c423d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.compute.manager [req-fdbaddfd-a556-4483-9bc2-b403fe8ed1b5 req-0e771557-045b-4c72-8b78-131237a7f1d5 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Neutron deleted interface 0ef76712-0557-4507-9aa5-9b06e55c423d; detaching it from the instance and deleting it from the info cache
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.network.neutron [req-fdbaddfd-a556-4483-9bc2-b403fe8ed1b5 req-0e771557-045b-4c72-8b78-131237a7f1d5 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Updating instance_info_cache with network_info: [{"id": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "address": "fa:16:3e:d6:6a:48", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbf77752-f9", "ovs_interfaceid": "bbf77752-f982-43cd-baf6-b77c4a13f45d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "address": "fa:16:3e:e7:b8:e8", "network": {"id": "930799b8-d9ca-4ad4-820e-ca437cfc9404", "bridge": "br-int", "label": "tempest-device-tagging-net1-2135016948", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "673f05654a4d491eb5cc315db2b77f9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f7e8485-0e", "ovs_interfaceid": "9f7e8485-0e8a-4eb1-bcb5-097e287b2878", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance spawned successfully.
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-fdbaddfd-a556-4483-9bc2-b403fe8ed1b5 req-0e771557-045b-4c72-8b78-131237a7f1d5 service nova] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Detach interface failed, port_id=0ef76712-0557-4507-9aa5-9b06e55c423d, reason: Instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055967.3781037, 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] VM Started (Lifecycle Event)
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73503) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 13:19:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58a2c7e1-8fb2-4ae1-be10-0b9c2036dfc1 tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:28 user nova-compute[73503]: INFO nova.compute.manager [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Took 2.89 seconds to detach 3 volumes for instance.
Aug 26 13:19:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:28 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:19:28 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:19:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:28 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Deleted allocations for instance acf6501e-5c82-4c7d-a76a-d0a1b8c5305f
Aug 26 13:19:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30f9bfeb-c9da-4f24-9b1c-d8fe6a2efbde tempest-TaggedBootDevicesTest_v242-1198062199 tempest-TaggedBootDevicesTest_v242-1198062199-project-member] Lock "acf6501e-5c82-4c7d-a76a-d0a1b8c5305f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.832s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:29 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055954.7524045, de9a2cdb-bee4-4901-8dac-34ca47682cdf => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:29 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] VM Stopped (Lifecycle Event)
Aug 26 13:19:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-724217dd-0d05-4237-9202-8408bb3d03a9 None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Snapshot image upload complete
Aug 26 13:19:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b5ad3409-cc85-4975-8e90-741cbab7c006 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Took 5.61 seconds to snapshot the instance on the hypervisor.
Aug 26 13:19:30 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693055955.1016212, acf6501e-5c82-4c7d-a76a-d0a1b8c5305f => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:30 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] VM Stopped (Lifecycle Event)
Aug 26 13:19:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5ed93469-b188-4b16-9241-2baacf0fbdff None None] [instance: acf6501e-5c82-4c7d-a76a-d0a1b8c5305f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:19:34 user nova-compute[73503]: INFO nova.compute.claims [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Claim successful on node user
Aug 26 13:19:34 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:19:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:19:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.policy [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd620945d8b4acabdf767d34fe696f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b69eae5d6f48968913dc31408311bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:19:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Creating image(s)
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk 1073741824" returned: 0 in 0.050s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:19:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Cannot resize image /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Ensure instance console log exists: /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Successfully created port: 161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Successfully updated port: 161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquired lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-changed-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Refreshing instance network info cache due to event network-changed-161e50eb-2232-4f63-bb55-c642cb4db883. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:19:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] Acquiring lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Releasing lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Instance network_info: |[{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] Acquired lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Refreshing network info cache for port 161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Start _get_guest_xml network_info=[{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:19:37 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:19:37 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.objects.instance [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:19:37 user nova-compute[73503]:   <uuid>2a4aee9a-2301-4f73-a1fa-479dfc57893b</uuid>
Aug 26 13:19:37 user nova-compute[73503]:   <name>instance-00000014</name>
Aug 26 13:19:37 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:19:37 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:19:37 user nova-compute[73503]:   <metadata>
Aug 26 13:19:37 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:19:37 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:19:37 user nova-compute[73503]:       <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:19:37 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:19:37</nova:creationTime>
Aug 26 13:19:37 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:19:37 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:19:37 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:19:37 user nova-compute[73503]:       <nova:owner>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:19:37 user nova-compute[73503]:       </nova:owner>
Aug 26 13:19:37 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:19:37 user nova-compute[73503]:       <nova:ports>
Aug 26 13:19:37 user nova-compute[73503]:         <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:19:37 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:19:37 user nova-compute[73503]:         </nova:port>
Aug 26 13:19:37 user nova-compute[73503]:       </nova:ports>
Aug 26 13:19:37 user nova-compute[73503]:     </nova:instance>
Aug 26 13:19:37 user nova-compute[73503]:   </metadata>
Aug 26 13:19:37 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:19:37 user nova-compute[73503]:     <system>
Aug 26 13:19:37 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:19:37 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:19:37 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:19:37 user nova-compute[73503]:       <entry name="serial">2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:19:37 user nova-compute[73503]:       <entry name="uuid">2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:19:37 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:19:37 user nova-compute[73503]:     </system>
Aug 26 13:19:37 user nova-compute[73503]:   </sysinfo>
Aug 26 13:19:37 user nova-compute[73503]:   <os>
Aug 26 13:19:37 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:19:37 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:19:37 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:19:37 user nova-compute[73503]:   </os>
Aug 26 13:19:37 user nova-compute[73503]:   <features>
Aug 26 13:19:37 user nova-compute[73503]:     <acpi/>
Aug 26 13:19:37 user nova-compute[73503]:     <apic/>
Aug 26 13:19:37 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:19:37 user nova-compute[73503]:   </features>
Aug 26 13:19:37 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:19:37 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:19:37 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:19:37 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:19:37 user nova-compute[73503]:   </clock>
Aug 26 13:19:37 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:19:37 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:19:37 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:19:37 user nova-compute[73503]:   </cpu>
Aug 26 13:19:37 user nova-compute[73503]:   <devices>
Aug 26 13:19:37 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:19:37 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:19:37 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk"/>
Aug 26 13:19:37 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:19:37 user nova-compute[73503]:     </disk>
Aug 26 13:19:37 user nova-compute[73503]:     <disk type="file" device="cdrom">
Aug 26 13:19:37 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 13:19:37 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config"/>
Aug 26 13:19:37 user nova-compute[73503]:       <target dev="hda" bus="ide"/>
Aug 26 13:19:37 user nova-compute[73503]:     </disk>
Aug 26 13:19:37 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:19:37 user nova-compute[73503]:       <mac address="fa:16:3e:0e:a6:5c"/>
Aug 26 13:19:37 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:19:37 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:19:37 user nova-compute[73503]:       <target dev="tap161e50eb-22"/>
Aug 26 13:19:37 user nova-compute[73503]:     </interface>
Aug 26 13:19:37 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:19:37 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log" append="off"/>
Aug 26 13:19:37 user nova-compute[73503]:     </serial>
Aug 26 13:19:37 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:19:37 user nova-compute[73503]:     <video>
Aug 26 13:19:37 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:19:37 user nova-compute[73503]:     </video>
Aug 26 13:19:37 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:19:37 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:19:37 user nova-compute[73503]:     </rng>
Aug 26 13:19:37 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:19:37 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:19:37 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:19:37 user nova-compute[73503]:     </memballoon>
Aug 26 13:19:37 user nova-compute[73503]:   </devices>
Aug 26 13:19:37 user nova-compute[73503]: </domain>
Aug 26 13:19:37 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG os_vif [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap161e50eb-22, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap161e50eb-22, col_values=(('external_ids', {'iface-id': '161e50eb-2232-4f63-bb55-c642cb4db883', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a6:5c', 'vm-uuid': '2a4aee9a-2301-4f73-a1fa-479dfc57893b'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:37 user nova-compute[73503]: INFO os_vif [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22')
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No BDM found with device name hda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No VIF found with MAC fa:16:3e:0e:a6:5c, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:19:37 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Using config drive
Aug 26 13:19:37 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Creating config drive at /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config
Aug 26 13:19:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp06tt3a1z {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp06tt3a1z" returned: 0 in 0.070s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updated VIF entry in instance network info cache for port 161e50eb-2232-4f63-bb55-c642cb4db883. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:19:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-be043f8b-f60e-4a1d-84d0-13db8abef7c1 req-2d960286-847e-4f12-ae9e-e1b61b74b95e service nova] Releasing lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-424344b2-bc59-490b-ad4c-4bdc371a35b1 req-b758ea4b-531c-4119-929f-bb881497c739 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-424344b2-bc59-490b-ad4c-4bdc371a35b1 req-b758ea4b-531c-4119-929f-bb881497c739 service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-424344b2-bc59-490b-ad4c-4bdc371a35b1 req-b758ea4b-531c-4119-929f-bb881497c739 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-424344b2-bc59-490b-ad4c-4bdc371a35b1 req-b758ea4b-531c-4119-929f-bb881497c739 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-424344b2-bc59-490b-ad4c-4bdc371a35b1 req-b758ea4b-531c-4119-929f-bb881497c739 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:39 user nova-compute[73503]: WARNING nova.compute.manager [req-424344b2-bc59-490b-ad4c-4bdc371a35b1 req-b758ea4b-531c-4119-929f-bb881497c739 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 for instance with vm_state building and task_state spawning.
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:19:40 user nova-compute[73503]: INFO nova.compute.claims [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Claim successful on node user
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:19:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:19:40 user nova-compute[73503]: DEBUG nova.policy [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd5b0cb95ba4c6984a9fe5085c87207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84b5b1338f040709bafbe65939ac8e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Creating image(s)
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.043s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e3a096a-4a9d-4c8a-a685-ad4de2af2626 req-8d52298f-1380-4607-a5ec-7be8023b4f86 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e3a096a-4a9d-4c8a-a685-ad4de2af2626 req-8d52298f-1380-4607-a5ec-7be8023b4f86 service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e3a096a-4a9d-4c8a-a685-ad4de2af2626 req-8d52298f-1380-4607-a5ec-7be8023b4f86 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e3a096a-4a9d-4c8a-a685-ad4de2af2626 req-8d52298f-1380-4607-a5ec-7be8023b4f86 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e3a096a-4a9d-4c8a-a685-ad4de2af2626 req-8d52298f-1380-4607-a5ec-7be8023b4f86 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:41 user nova-compute[73503]: WARNING nova.compute.manager [req-7e3a096a-4a9d-4c8a-a685-ad4de2af2626 req-8d52298f-1380-4607-a5ec-7be8023b4f86 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 for instance with vm_state building and task_state spawning.
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055981.5721543, 2a4aee9a-2301-4f73-a1fa-479dfc57893b => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] VM Resumed (Lifecycle Event)
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Instance spawned successfully.
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055981.5786402, 2a4aee9a-2301-4f73-a1fa-479dfc57893b => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] VM Started (Lifecycle Event)
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk 1073741824" returned: 0 in 0.147s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Successfully created port: a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Took 6.61 seconds to spawn the instance on the hypervisor.
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:19:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:19:41 user nova-compute[73503]: INFO nova.compute.manager [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Took 7.70 seconds to build instance.
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c08ab4a-9495-46f9-9f12-91a27730b808 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.817s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Cannot resize image /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Ensure instance console log exists: /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Successfully updated port: a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing instance network info cache due to event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance network_info: |[{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Start _get_guest_xml network_info=[{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:19:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:19:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:19:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641088509',display_name='tempest-ServerRescueNegativeTestJSON-server-1641088509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641088509',id=21,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnijJTcPmg6p6xLu5FGsmewTPcgK1XPz6UAj41pxPqXBHWR8SDB2XgYe3x2ud0QGgrh/tNcxGSlBI6e81S6cuUDM5GjrCOlp4KqymQt8B3qDguHRHeGysDzpBaKdsG+2w==',key_name='tempest-keypair-1726069367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-stz3l4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=2a7f4f67-ae12-4760-b45a-77e9cca24132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.objects.instance [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:19:43 user nova-compute[73503]:   <uuid>2a7f4f67-ae12-4760-b45a-77e9cca24132</uuid>
Aug 26 13:19:43 user nova-compute[73503]:   <name>instance-00000015</name>
Aug 26 13:19:43 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:19:43 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:19:43 user nova-compute[73503]:   <metadata>
Aug 26 13:19:43 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:19:43 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:19:43 user nova-compute[73503]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1641088509</nova:name>
Aug 26 13:19:43 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:19:42</nova:creationTime>
Aug 26 13:19:43 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:19:43 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:19:43 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:19:43 user nova-compute[73503]:       <nova:owner>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:user uuid="9cd5b0cb95ba4c6984a9fe5085c87207">tempest-ServerRescueNegativeTestJSON-993610223-project-member</nova:user>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:project uuid="a84b5b1338f040709bafbe65939ac8e7">tempest-ServerRescueNegativeTestJSON-993610223</nova:project>
Aug 26 13:19:43 user nova-compute[73503]:       </nova:owner>
Aug 26 13:19:43 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:19:43 user nova-compute[73503]:       <nova:ports>
Aug 26 13:19:43 user nova-compute[73503]:         <nova:port uuid="a1b437ed-6a04-4d98-af40-196b0ba33def">
Aug 26 13:19:43 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:19:43 user nova-compute[73503]:         </nova:port>
Aug 26 13:19:43 user nova-compute[73503]:       </nova:ports>
Aug 26 13:19:43 user nova-compute[73503]:     </nova:instance>
Aug 26 13:19:43 user nova-compute[73503]:   </metadata>
Aug 26 13:19:43 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:19:43 user nova-compute[73503]:     <system>
Aug 26 13:19:43 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:19:43 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:19:43 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:19:43 user nova-compute[73503]:       <entry name="serial">2a7f4f67-ae12-4760-b45a-77e9cca24132</entry>
Aug 26 13:19:43 user nova-compute[73503]:       <entry name="uuid">2a7f4f67-ae12-4760-b45a-77e9cca24132</entry>
Aug 26 13:19:43 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:19:43 user nova-compute[73503]:     </system>
Aug 26 13:19:43 user nova-compute[73503]:   </sysinfo>
Aug 26 13:19:43 user nova-compute[73503]:   <os>
Aug 26 13:19:43 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:19:43 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:19:43 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:19:43 user nova-compute[73503]:   </os>
Aug 26 13:19:43 user nova-compute[73503]:   <features>
Aug 26 13:19:43 user nova-compute[73503]:     <acpi/>
Aug 26 13:19:43 user nova-compute[73503]:     <apic/>
Aug 26 13:19:43 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:19:43 user nova-compute[73503]:   </features>
Aug 26 13:19:43 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:19:43 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:19:43 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:19:43 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:19:43 user nova-compute[73503]:   </clock>
Aug 26 13:19:43 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:19:43 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:19:43 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:19:43 user nova-compute[73503]:   </cpu>
Aug 26 13:19:43 user nova-compute[73503]:   <devices>
Aug 26 13:19:43 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:19:43 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:19:43 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk"/>
Aug 26 13:19:43 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:19:43 user nova-compute[73503]:     </disk>
Aug 26 13:19:43 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:19:43 user nova-compute[73503]:       <mac address="fa:16:3e:14:4c:4d"/>
Aug 26 13:19:43 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:19:43 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:19:43 user nova-compute[73503]:       <target dev="tapa1b437ed-6a"/>
Aug 26 13:19:43 user nova-compute[73503]:     </interface>
Aug 26 13:19:43 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:19:43 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/console.log" append="off"/>
Aug 26 13:19:43 user nova-compute[73503]:     </serial>
Aug 26 13:19:43 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:19:43 user nova-compute[73503]:     <video>
Aug 26 13:19:43 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:19:43 user nova-compute[73503]:     </video>
Aug 26 13:19:43 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:19:43 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:19:43 user nova-compute[73503]:     </rng>
Aug 26 13:19:43 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:19:43 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:19:43 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:19:43 user nova-compute[73503]:     </memballoon>
Aug 26 13:19:43 user nova-compute[73503]:   </devices>
Aug 26 13:19:43 user nova-compute[73503]: </domain>
Aug 26 13:19:43 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641088509',display_name='tempest-ServerRescueNegativeTestJSON-server-1641088509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641088509',id=21,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnijJTcPmg6p6xLu5FGsmewTPcgK1XPz6UAj41pxPqXBHWR8SDB2XgYe3x2ud0QGgrh/tNcxGSlBI6e81S6cuUDM5GjrCOlp4KqymQt8B3qDguHRHeGysDzpBaKdsG+2w==',key_name='tempest-keypair-1726069367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-stz3l4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=2a7f4f67-ae12-4760-b45a-77e9cca24132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG os_vif [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1b437ed-6a, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1b437ed-6a, col_values=(('external_ids', {'iface-id': 'a1b437ed-6a04-4d98-af40-196b0ba33def', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:4c:4d', 'vm-uuid': '2a7f4f67-ae12-4760-b45a-77e9cca24132'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:43 user nova-compute[73503]: INFO os_vif [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a')
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:14:4c:4d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updated VIF entry in instance network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:19:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-01cea06b-5c08-4bed-9744-7d34c3a1b88b req-69494051-2ad9-4e2a-8010-d93e99af4834 service nova] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-1fbe5c56-07a3-4395-9ca4-7b1f15e53960 req-aca95eea-4050-4d46-98fe-0135f55723e1 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1fbe5c56-07a3-4395-9ca4-7b1f15e53960 req-aca95eea-4050-4d46-98fe-0135f55723e1 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1fbe5c56-07a3-4395-9ca4-7b1f15e53960 req-aca95eea-4050-4d46-98fe-0135f55723e1 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1fbe5c56-07a3-4395-9ca4-7b1f15e53960 req-aca95eea-4050-4d46-98fe-0135f55723e1 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-1fbe5c56-07a3-4395-9ca4-7b1f15e53960 req-aca95eea-4050-4d46-98fe-0135f55723e1 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:44 user nova-compute[73503]: WARNING nova.compute.manager [req-1fbe5c56-07a3-4395-9ca4-7b1f15e53960 req-aca95eea-4050-4d46-98fe-0135f55723e1 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state building and task_state spawning.
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055986.7084212, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Resumed (Lifecycle Event)
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance spawned successfully.
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693055986.7128444, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Started (Lifecycle Event)
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-3de80b45-e814-478d-b45f-e44d8bb4630b req-66239c90-eae5-4555-ba8a-ba2c847a4a18 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3de80b45-e814-478d-b45f-e44d8bb4630b req-66239c90-eae5-4555-ba8a-ba2c847a4a18 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3de80b45-e814-478d-b45f-e44d8bb4630b req-66239c90-eae5-4555-ba8a-ba2c847a4a18 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3de80b45-e814-478d-b45f-e44d8bb4630b req-66239c90-eae5-4555-ba8a-ba2c847a4a18 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-3de80b45-e814-478d-b45f-e44d8bb4630b req-66239c90-eae5-4555-ba8a-ba2c847a4a18 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:19:46 user nova-compute[73503]: WARNING nova.compute.manager [req-3de80b45-e814-478d-b45f-e44d8bb4630b req-66239c90-eae5-4555-ba8a-ba2c847a4a18 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state building and task_state spawning.
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 26 13:19:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:19:46 user nova-compute[73503]: INFO nova.compute.manager [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Took 6.84 seconds to build instance.
Aug 26 13:19:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-68b17df8-1763-4e49-8cae-22297c86c297 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.929s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:19:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:19:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:06 user nova-compute[73503]: INFO nova.compute.manager [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Terminating instance
Aug 26 13:20:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ce159d2-5d19-409a-b05f-fce79dafe2ad req-d203ef29-571f-4b57-a0d2-8fa1c412ffe3 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-vif-unplugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ce159d2-5d19-409a-b05f-fce79dafe2ad req-d203ef29-571f-4b57-a0d2-8fa1c412ffe3 service nova] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ce159d2-5d19-409a-b05f-fce79dafe2ad req-d203ef29-571f-4b57-a0d2-8fa1c412ffe3 service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ce159d2-5d19-409a-b05f-fce79dafe2ad req-d203ef29-571f-4b57-a0d2-8fa1c412ffe3 service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ce159d2-5d19-409a-b05f-fce79dafe2ad req-d203ef29-571f-4b57-a0d2-8fa1c412ffe3 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] No waiting events found dispatching network-vif-unplugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ce159d2-5d19-409a-b05f-fce79dafe2ad req-d203ef29-571f-4b57-a0d2-8fa1c412ffe3 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-vif-unplugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Instance destroyed successfully.
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.objects.instance [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lazy-loading 'resources' on Instance uuid 950df9cd-10d7-45cb-9714-9ee01f508acd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-258058592',display_name='tempest-ServersNegativeTestJSON-server-258058592',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-258058592',id=4,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='933ef3f76b494bbaabf6511c70fc312c',ramdisk_id='',reservation_id='r-f2cyowm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-410549196',owner_user_name='tempest-ServersNegativeTestJSON-410549196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:11:22Z,user_data=None,user_id='e23ee63bc296443fbe8224f94cff507a',uuid=950df9cd-10d7-45cb-9714-9ee01f508acd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converting VIF {"id": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "address": "fa:16:3e:7f:8d:84", "network": {"id": "35afd038-d719-40c4-99f6-c93cc0bfd514", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1344708787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "933ef3f76b494bbaabf6511c70fc312c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77d912b-20", "ovs_interfaceid": "b77d912b-20b6-4be1-9b84-eb14ab1b1ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG os_vif [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb77d912b-20, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:20:07 user nova-compute[73503]: INFO os_vif [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:8d:84,bridge_name='br-int',has_traffic_filtering=True,id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3,network=Network(35afd038-d719-40c4-99f6-c93cc0bfd514),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77d912b-20')
Aug 26 13:20:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Deleting instance files /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd_del
Aug 26 13:20:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Deletion of /opt/stack/data/nova/instances/950df9cd-10d7-45cb-9714-9ee01f508acd_del complete
Aug 26 13:20:07 user nova-compute[73503]: INFO nova.compute.manager [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 26 13:20:07 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:08 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Took 0.49 seconds to deallocate network for instance.
Aug 26 13:20:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-d438f9ea-ca90-4242-895f-483fe55b240a req-5793c370-f7dc-4616-a164-92103b66bfb9 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-vif-deleted-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:08 user nova-compute[73503]: INFO nova.compute.manager [req-d438f9ea-ca90-4242-895f-483fe55b240a req-5793c370-f7dc-4616-a164-92103b66bfb9 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Neutron deleted interface b77d912b-20b6-4be1-9b84-eb14ab1b1ed3; detaching it from the instance and deleting it from the info cache
Aug 26 13:20:08 user nova-compute[73503]: DEBUG nova.network.neutron [req-d438f9ea-ca90-4242-895f-483fe55b240a req-5793c370-f7dc-4616-a164-92103b66bfb9 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-d438f9ea-ca90-4242-895f-483fe55b240a req-5793c370-f7dc-4616-a164-92103b66bfb9 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Detach interface failed, port_id=b77d912b-20b6-4be1-9b84-eb14ab1b1ed3, reason: Instance 950df9cd-10d7-45cb-9714-9ee01f508acd could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:08 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Deleted allocations for instance 950df9cd-10d7-45cb-9714-9ee01f508acd
Aug 26 13:20:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c4aaeff1-72e0-4998-83e7-95a11dec23ae tempest-ServersNegativeTestJSON-410549196 tempest-ServersNegativeTestJSON-410549196-project-member] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:08 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-58f1f28d-b9a2-486e-b703-98d238fd4326 req-04c5b7d6-ac73-4514-be37-ae90aae31d04 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received event network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-58f1f28d-b9a2-486e-b703-98d238fd4326 req-04c5b7d6-ac73-4514-be37-ae90aae31d04 service nova] Acquiring lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-58f1f28d-b9a2-486e-b703-98d238fd4326 req-04c5b7d6-ac73-4514-be37-ae90aae31d04 service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-58f1f28d-b9a2-486e-b703-98d238fd4326 req-04c5b7d6-ac73-4514-be37-ae90aae31d04 service nova] Lock "950df9cd-10d7-45cb-9714-9ee01f508acd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-58f1f28d-b9a2-486e-b703-98d238fd4326 req-04c5b7d6-ac73-4514-be37-ae90aae31d04 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] No waiting events found dispatching network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:09 user nova-compute[73503]: WARNING nova.compute.manager [req-58f1f28d-b9a2-486e-b703-98d238fd4326 req-04c5b7d6-ac73-4514-be37-ae90aae31d04 service nova] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Received unexpected event network-vif-plugged-b77d912b-20b6-4be1-9b84-eb14ab1b1ed3 for instance with vm_state deleted and task_state None.
Aug 26 13:20:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:12 user nova-compute[73503]: INFO nova.compute.manager [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Terminating instance
Aug 26 13:20:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-ae9912cc-82b8-46ee-aec9-fb9363258a9b req-85f0e337-7bb1-45ab-bd4f-c806e1fcda90 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ae9912cc-82b8-46ee-aec9-fb9363258a9b req-85f0e337-7bb1-45ab-bd4f-c806e1fcda90 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ae9912cc-82b8-46ee-aec9-fb9363258a9b req-85f0e337-7bb1-45ab-bd4f-c806e1fcda90 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ae9912cc-82b8-46ee-aec9-fb9363258a9b req-85f0e337-7bb1-45ab-bd4f-c806e1fcda90 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-ae9912cc-82b8-46ee-aec9-fb9363258a9b req-85f0e337-7bb1-45ab-bd4f-c806e1fcda90 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-ae9912cc-82b8-46ee-aec9-fb9363258a9b req-85f0e337-7bb1-45ab-bd4f-c806e1fcda90 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-unplugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:20:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Instance destroyed successfully.
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.objects.instance [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lazy-loading 'resources' on Instance uuid 11b30921-6ad1-4c04-8b5b-a98220732787 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1082919212',display_name='tempest-ServerActionsTestOtherB-server-1082919212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1082919212',id=5,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXeNz/NA4/19Mi03ft/cOehqxvDNCcEC+HTb+lJM6UzpPycH+r7S/ExukIVPPe+Z15FDcPrRVRXXg0K5Rf06Z2khihB9MMBkf6pO1K8s+4ACv4vIbRraRFMN90Xgdj/g==',key_name='tempest-keypair-517932551',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f45bb3c25384abfba41a5146a55a7e7',ramdisk_id='',reservation_id='r-nm1hkyvi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-100333381',owner_user_name='tempest-ServerActionsTestOtherB-100333381-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c0aa45010e48a0ba0082cfff7b2cc5',uuid=11b30921-6ad1-4c04-8b5b-a98220732787,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converting VIF {"id": "70726c37-f682-40cd-9155-843aca57acf4", "address": "fa:16:3e:c5:4c:46", "network": {"id": "ee9f881b-578d-4503-8704-04b2b5bad14d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1235919171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f45bb3c25384abfba41a5146a55a7e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70726c37-f6", "ovs_interfaceid": "70726c37-f682-40cd-9155-843aca57acf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_vif [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70726c37-f6, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:13 user nova-compute[73503]: INFO os_vif [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4c:46,bridge_name='br-int',has_traffic_filtering=True,id=70726c37-f682-40cd-9155-843aca57acf4,network=Network(ee9f881b-578d-4503-8704-04b2b5bad14d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70726c37-f6')
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhbSkqZu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:20:13 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e418b47-e88b-4d3a-afb9-773bc6c9be28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a75cf2-af2a-48f9-bebe-ac7c3b4923c8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:20:13 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:20:13 user nova-compute[73503]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:20:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:20:13 user nova-compute[73503]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 (non-flash)
Aug 26 13:20:13 user nova-compute[73503]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:20:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31437e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84'): ({'sdf'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Removing single pathed devices sdf {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc19f48-ae88-4b83-aefd-b21c4a2d188e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[853b3351-84fd-466e-9d45-ecaea5fe4092]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Flushing IO for device /dev/sdf {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b952af3-d07c-4710-b030-d753d4c8b2bf]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[376f81d3-a23f-409b-bdd8-eb423a1ced24]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e16db-2810-4e2e-af97-845e2ea053d4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581adf0-95fc-4a75-b996-02964b1427d1]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260]
Aug 26 13:20:13 user nova-compute[73503]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84, portal: 172.16.0.220,3260] successful.
Aug 26 13:20:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.compute.manager [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Detaching volume 766572c7-d86f-404c-bfde-2fa4f777233d
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:957d26ff-ff9f-404f-bd86-542b3fab7f84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[587a1c3f-128d-47a5-a713-694890bb8ab1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] <== disconnect_volume: return (314ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Deleting instance files /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787_del
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Deletion of /opt/stack/data/nova/instances/11b30921-6ad1-4c04-8b5b-a98220732787_del complete
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.virt.block_device [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Attempting to driver detach volume 766572c7-d86f-404c-bfde-2fa4f777233d from mountpoint /dev/vdb
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.compute.manager [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Attempting to detach device vdb from instance ab4f580b-7abb-45b1-84fd-79957526124a from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:20:13 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:20:13 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:20:13 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:20:13 user nova-compute[73503]:   <serial>766572c7-d86f-404c-bfde-2fa4f777233d</serial>
Aug 26 13:20:13 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:20:13 user nova-compute[73503]: </disk>
Aug 26 13:20:13 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:20:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully detached device vdb from instance ab4f580b-7abb-45b1-84fd-79957526124a from the persistent domain config.
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab4f580b-7abb-45b1-84fd-79957526124a from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:20:13 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:20:13 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:20:13 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:20:13 user nova-compute[73503]:   <serial>766572c7-d86f-404c-bfde-2fa4f777233d</serial>
Aug 26 13:20:13 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:20:13 user nova-compute[73503]: </disk>
Aug 26 13:20:13 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056014.0038922, ab4f580b-7abb-45b1-84fd-79957526124a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:20:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully detached device vdb from instance ab4f580b-7abb-45b1-84fd-79957526124a from the live domain config.
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLrNXqYo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:20:14 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7819c521-a60d-408d-b9b5-527887ad76e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145ad96-4abd-4dde-b7de-5a6ba481d1f0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:20:14 user nova-compute[73503]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:20:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d (non-flash)
Aug 26 13:20:14 user nova-compute[73503]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:20:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd314300160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb525c3-d1a9-4a47-a826-0d1a8f00c6d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f8700-c06c-4654-8c01-aa5b7f2a15e9]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7212cd-9b4f-49ca-b9c8-8d784be803d3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff0e31e-52a1-48ed-8334-687fbea59744]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d6b9d1-3b58-4f04-9551-34491526f0e2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d6705-8eb2-4f68-b150-e0355eeab77c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260]
Aug 26 13:20:14 user nova-compute[73503]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d, portal: 172.16.0.220,3260] successful.
Aug 26 13:20:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766572c7-d86f-404c-bfde-2fa4f777233d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135a0d9-96b2-49d0-a681-8876d18f7443]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== disconnect_volume: return (389ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-7aeebbaa-b7f8-4a42-9dc0-eb9a67cce5f1 req-918592b8-3342-4b97-8d5c-ef3a94d42993 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-deleted-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:14 user nova-compute[73503]: INFO nova.compute.manager [req-7aeebbaa-b7f8-4a42-9dc0-eb9a67cce5f1 req-918592b8-3342-4b97-8d5c-ef3a94d42993 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Neutron deleted interface 70726c37-f682-40cd-9155-843aca57acf4; detaching it from the instance and deleting it from the info cache
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.network.neutron [req-7aeebbaa-b7f8-4a42-9dc0-eb9a67cce5f1 req-918592b8-3342-4b97-8d5c-ef3a94d42993 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:14 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Took 1.12 seconds to deallocate network for instance.
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-7aeebbaa-b7f8-4a42-9dc0-eb9a67cce5f1 req-918592b8-3342-4b97-8d5c-ef3a94d42993 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Detach interface failed, port_id=70726c37-f682-40cd-9155-843aca57acf4, reason: Instance 11b30921-6ad1-4c04-8b5b-a98220732787 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-49748cdc-093c-44de-9cd4-08c61104b902 req-0ff6f5af-490e-406a-bafc-6ff9d6031d59 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-49748cdc-093c-44de-9cd4-08c61104b902 req-0ff6f5af-490e-406a-bafc-6ff9d6031d59 service nova] Acquiring lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-49748cdc-093c-44de-9cd4-08c61104b902 req-0ff6f5af-490e-406a-bafc-6ff9d6031d59 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-49748cdc-093c-44de-9cd4-08c61104b902 req-0ff6f5af-490e-406a-bafc-6ff9d6031d59 service nova] Lock "11b30921-6ad1-4c04-8b5b-a98220732787-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-49748cdc-093c-44de-9cd4-08c61104b902 req-0ff6f5af-490e-406a-bafc-6ff9d6031d59 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] No waiting events found dispatching network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:14 user nova-compute[73503]: WARNING nova.compute.manager [req-49748cdc-093c-44de-9cd4-08c61104b902 req-0ff6f5af-490e-406a-bafc-6ff9d6031d59 service nova] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Received unexpected event network-vif-plugged-70726c37-f682-40cd-9155-843aca57acf4 for instance with vm_state active and task_state deleting.
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:15 user nova-compute[73503]: INFO nova.compute.manager [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Took 0.82 seconds to detach 1 volumes for instance.
Aug 26 13:20:15 user nova-compute[73503]: DEBUG nova.objects.instance [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'flavor' on Instance uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-abd83a4c-8be0-475c-874f-1e0e5f0aaa05 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.183s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:15 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '11b30921-6ad1-4c04-8b5b-a98220732787' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '11b30921-6ad1-4c04-8b5b-a98220732787' (instance-00000005)
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:20:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:15 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Deleted allocations for instance 11b30921-6ad1-4c04-8b5b-a98220732787
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2385890b-70f8-4e7f-8a73-a99c6fdd1ed7 tempest-ServerActionsTestOtherB-100333381 tempest-ServerActionsTestOtherB-100333381-project-member] Lock "11b30921-6ad1-4c04-8b5b-a98220732787" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.804s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:17 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:20:17 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7238MB free_disk=25.247371673583984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ab4f580b-7abb-45b1-84fd-79957526124a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:20:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:20:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:20:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:20:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:20:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:20:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:20:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:20:22 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056007.4371984, 950df9cd-10d7-45cb-9714-9ee01f508acd => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:20:22 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] VM Stopped (Lifecycle Event)
Aug 26 13:20:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0fc973be-81ed-4578-aac0-37fba2819019 None None] [instance: 950df9cd-10d7-45cb-9714-9ee01f508acd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:20:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:20:28 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056013.03374, 11b30921-6ad1-4c04-8b5b-a98220732787 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:20:28 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] VM Stopped (Lifecycle Event)
Aug 26 13:20:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d0e042ca-9112-4bb9-800b-73a18e8125bc None None] [instance: 11b30921-6ad1-4c04-8b5b-a98220732787] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:20:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:20:32 user nova-compute[73503]: INFO nova.compute.claims [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Claim successful on node user
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:20:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:20:32 user nova-compute[73503]: INFO nova.virt.block_device [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Booting with blank volume at /dev/vda
Aug 26 13:20:32 user nova-compute[73503]: DEBUG nova.policy [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a89a1af8a5843ed93bf6f11556e1f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b965a76e3c04068b81deca48c6efba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:20:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:34 user nova-compute[73503]: INFO nova.compute.manager [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Terminating instance
Aug 26 13:20:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Successfully created port: 4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3dc9aee-a14e-446b-81b2-b2c1fcb0fa74 req-125ad99b-aac5-49f3-ae64-ed521f95f49c service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e3dc9aee-a14e-446b-81b2-b2c1fcb0fa74 req-125ad99b-aac5-49f3-ae64-ed521f95f49c service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e3dc9aee-a14e-446b-81b2-b2c1fcb0fa74 req-125ad99b-aac5-49f3-ae64-ed521f95f49c service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e3dc9aee-a14e-446b-81b2-b2c1fcb0fa74 req-125ad99b-aac5-49f3-ae64-ed521f95f49c service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3dc9aee-a14e-446b-81b2-b2c1fcb0fa74 req-125ad99b-aac5-49f3-ae64-ed521f95f49c service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3dc9aee-a14e-446b-81b2-b2c1fcb0fa74 req-125ad99b-aac5-49f3-ae64-ed521f95f49c service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Instance destroyed successfully.
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.objects.instance [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lazy-loading 'resources' on Instance uuid 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-175016667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-834091793',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpgahKA8CJB13X+LFY/2mON6eWUOF6McKJjH37nhvAmdSCBwTfd3rM3EekabfFigEY0PKAbk6iHI/UNbfPhAHbso39f9MZDKm+ioagie1d7kHWpL+F+SHbQ5tSSQ5Zoxw==',key_name='tempest-keypair-596006166',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd48f06574c841cfbce3b3fbe9f18502',ramdisk_id='',reservation_id='r-p723fz9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-331387927',owner_user_name='tempest-ServerActionsV293TestJSON-331387927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29dbdc58b7f24255988b145cee0cdc15',uuid=5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converting VIF {"id": "d3dc7974-d54e-4973-948a-2097c25cb99a", "address": "fa:16:3e:7f:54:9d", "network": {"id": "3a590ed6-a90c-4d38-9095-9480862e6362", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1520592685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd48f06574c841cfbce3b3fbe9f18502", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3dc7974-d5", "ovs_interfaceid": "d3dc7974-d54e-4973-948a-2097c25cb99a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_vif [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3dc7974-d5, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:20:35 user nova-compute[73503]: INFO os_vif [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:54:9d,bridge_name='br-int',has_traffic_filtering=True,id=d3dc7974-d54e-4973-948a-2097c25cb99a,network=Network(3a590ed6-a90c-4d38-9095-9480862e6362),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3dc7974-d5')
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFTeqRxN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:20:35 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4cf2c6-11cb-4afb-a5c7-47c80216812a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf61ea-6458-4039-aa7d-d6984c349026]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:20:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 (non-flash)
Aug 26 13:20:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304429510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc35a04-2e01-4c49-aea0-033d528052ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e6b6e-1361-4694-b5d1-b0ba23a3e6c1]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc76b302-1571-4cc1-8148-194602fd9523]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.080s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6882f-46b2-463d-80a0-f3f248f22ae5]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[224cadf2-2053-491f-94fc-78c5fc8f3eaf]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92309ad-208c-4d5c-a553-8d0c2f302d8f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260]
Aug 26 13:20:35 user nova-compute[73503]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86, portal: 172.16.0.220,3260] successful.
Aug 26 13:20:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c26782a3-e1d2-47ad-ab79-2def94637c86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7b4b39-22d6-47b2-9271-86477fac19a3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] <== disconnect_volume: return (384ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:20:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Deleting instance files /opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd_del
Aug 26 13:20:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Deletion of /opt/stack/data/nova/instances/5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd_del complete
Aug 26 13:20:35 user nova-compute[73503]: INFO nova.compute.manager [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 26 13:20:35 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Successfully updated port: 4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-changed-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Refreshing instance network info cache due to event network-changed-4fc22ec9-afba-413e-9399-378319124489. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] Acquiring lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:36 user nova-compute[73503]: WARNING nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state deleting.
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:36 user nova-compute[73503]: WARNING nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state deleting.
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:36 user nova-compute[73503]: WARNING nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state deleting.
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-unplugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Acquiring lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] No waiting events found dispatching network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:36 user nova-compute[73503]: WARNING nova.compute.manager [req-4c325873-1135-4f68-ad50-75995e12ef2d req-ce8958bb-c772-4411-8206-84ee254d01f4 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received unexpected event network-vif-plugged-d3dc7974-d54e-4973-948a-2097c25cb99a for instance with vm_state active and task_state deleting.
Aug 26 13:20:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance network_info: |[{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] Acquired lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Refreshing network info cache for port 4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:37 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Took 1.89 seconds to deallocate network for instance.
Aug 26 13:20:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updated VIF entry in instance network info cache for port 4fc22ec9-afba-413e-9399-378319124489. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9fbb090-32e1-4740-b7bb-88ffbdb2c742 req-4167cc95-e4e0-4d4b-8aee-fd4733b45eb9 service nova] Releasing lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:20:38 user nova-compute[73503]: INFO nova.compute.manager [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 13:20:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Deleting volume: c26782a3-e1d2-47ad-ab79-2def94637c86 {{(pid=73503) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG os_brick.utils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d47768f-3e7b-4145-bd6a-eb5b21da7080]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc953c6-72a5-4de4-a5a9-677d063e76f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16778628-d89f-4bc5-a694-5597d2464755]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e809e09-afcb-486b-9296-d824981db57a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:20:38 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0151b1-c47b-43ed-b055-a0e5abf8520f]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG os_brick.utils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating existing volume attachment record: 22d4a4ae-a2fc-4a91-b511-8ce61594eac6 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-b6d32a45-eaac-4ab9-a31c-f2ac659be83a req-17b38b20-2d7f-41a8-9d53-97b4b5dc0592 service nova] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Received event network-vif-deleted-d3dc7974-d54e-4973-948a-2097c25cb99a {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:20:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:38 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Deleted allocations for instance 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd
Aug 26 13:20:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-11081e5b-4271-4898-ba34-d6031ad2ae6f tempest-ServerActionsV293TestJSON-331387927 tempest-ServerActionsV293TestJSON-331387927-project-member] Lock "5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.676s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:20:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-changed-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Refreshing instance network info cache due to event network-changed-ae2804bd-9d88-43ed-bb41-95ca9bbac159. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:20:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] Acquiring lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:20:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] Acquired lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:20:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Refreshing network info cache for port ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG nova.network.neutron [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updated VIF entry in instance network info cache for port ae2804bd-9d88-43ed-bb41-95ca9bbac159. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG nova.network.neutron [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating instance_info_cache with network_info: [{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bd76e3b9-b5c7-433d-8766-3254b6309bdd req-870a6be8-528d-46a0-a7a1-28c1cb83f785 service nova] Releasing lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG nova.objects.instance [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'flavor' on Instance uuid 6fb3f5db-a603-4982-8304-c4601a5c5b17 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:49 user nova-compute[73503]: INFO nova.compute.manager [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Attaching volume 93c89ff7-22d5-4f15-a4bd-d783a7f29893 to /dev/vdb
Aug 26 13:20:49 user nova-compute[73503]: DEBUG os_brick.utils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e27fa63-58fc-4e44-b0bb-8a4c349b009a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad7ead-abaf-416a-a7bd-e839d672a4ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3bbcf5-8681-4e8f-89ad-d13939682553]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76766a4e-94e1-4da3-97d5-79e8a1b718e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:20:49 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:20:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a9eb1-ee0d-46c9-91ff-e244aa912ec5]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG os_brick.utils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:20:49 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating existing volume attachment record: 947a60b2-8594-4be4-a49b-6178a1086966 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056035.1434345, 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:20:50 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] VM Stopped (Lifecycle Event)
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:20:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Creating image(s)
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Ensure instance console log exists: /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Start _get_guest_xml network_info=[{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6472acd9-81af-48fe-9650-0cfb8146dbd0', 'attached_at': '', 'detached_at': '', 'volume_id': '4f637674-bc8a-4cf9-9047-5af7b3e4b6be', 'serial': '4f637674-bc8a-4cf9-9047-5af7b3e4b6be'}, 'attachment_id': '22d4a4ae-a2fc-4a91-b511-8ce61594eac6', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-007fa242-b89d-43cd-bb93-225fa07cbfcf None None] [instance: 5921a2c0-4d9e-4a77-b57c-ebd3d7215fcd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:20:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:20:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:20:50 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:20:50 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:20:50 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:20:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[172975c6-408a-40ac-92e2-9483f6bce1a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:20:50 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c56be-447c-4db0-b55f-d9f835196dba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be] added
Aug 26 13:20:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55f8a15-c0a2-406a-a89d-65cc3720f966]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bb58ba-0bdf-48df-84c6-c4a823abc5cf]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiKESuzs {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiKESuzs" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[badea4e9-d378-4a93-aba4-563b606d21bf]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiKESuzs'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[948c6621-dc6d-4fa5-973f-3a74df6f412b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee46a47-25fc-420c-90e5-88142322b380]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:20:50 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:20:50 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:20:50 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:20:50 user nova-compute[73503]: 
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52c4b79-704d-407a-840a-6fa6c85c6782]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260]
Aug 26 13:20:50 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260] successful.
Aug 26 13:20:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7918cd0c-f481-4791-b9fb-dc0b70c158e8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[acff3448-e1a9-432d-ad1d-49239e92b47e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:20:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:20:50 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb337628-e990-4410-8e87-4814081fe004]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:20:50 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23563633030646561', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563633030646561', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934835306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934835306',id=22,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-d0e9400p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:20:33Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=6472acd9-81af-48fe-9650-0cfb8146dbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'pci_devices' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:20:51 user nova-compute[73503]:   <uuid>6472acd9-81af-48fe-9650-0cfb8146dbd0</uuid>
Aug 26 13:20:51 user nova-compute[73503]:   <name>instance-00000016</name>
Aug 26 13:20:51 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:20:51 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:20:51 user nova-compute[73503]:   <metadata>
Aug 26 13:20:51 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:20:51 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:20:51 user nova-compute[73503]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-934835306</nova:name>
Aug 26 13:20:51 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:20:50</nova:creationTime>
Aug 26 13:20:51 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:20:51 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:20:51 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:20:51 user nova-compute[73503]:       <nova:owner>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:user uuid="1a89a1af8a5843ed93bf6f11556e1f65">tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member</nova:user>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:project uuid="9b965a76e3c04068b81deca48c6efba6">tempest-ServerBootFromVolumeStableRescueTest-1652147779</nova:project>
Aug 26 13:20:51 user nova-compute[73503]:       </nova:owner>
Aug 26 13:20:51 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:20:51 user nova-compute[73503]:       <nova:ports>
Aug 26 13:20:51 user nova-compute[73503]:         <nova:port uuid="4fc22ec9-afba-413e-9399-378319124489">
Aug 26 13:20:51 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:20:51 user nova-compute[73503]:         </nova:port>
Aug 26 13:20:51 user nova-compute[73503]:       </nova:ports>
Aug 26 13:20:51 user nova-compute[73503]:     </nova:instance>
Aug 26 13:20:51 user nova-compute[73503]:   </metadata>
Aug 26 13:20:51 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:20:51 user nova-compute[73503]:     <system>
Aug 26 13:20:51 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:20:51 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:20:51 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:20:51 user nova-compute[73503]:       <entry name="serial">6472acd9-81af-48fe-9650-0cfb8146dbd0</entry>
Aug 26 13:20:51 user nova-compute[73503]:       <entry name="uuid">6472acd9-81af-48fe-9650-0cfb8146dbd0</entry>
Aug 26 13:20:51 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:20:51 user nova-compute[73503]:     </system>
Aug 26 13:20:51 user nova-compute[73503]:   </sysinfo>
Aug 26 13:20:51 user nova-compute[73503]:   <os>
Aug 26 13:20:51 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:20:51 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:20:51 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:20:51 user nova-compute[73503]:   </os>
Aug 26 13:20:51 user nova-compute[73503]:   <features>
Aug 26 13:20:51 user nova-compute[73503]:     <acpi/>
Aug 26 13:20:51 user nova-compute[73503]:     <apic/>
Aug 26 13:20:51 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:20:51 user nova-compute[73503]:   </features>
Aug 26 13:20:51 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:20:51 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:20:51 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:20:51 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:20:51 user nova-compute[73503]:   </clock>
Aug 26 13:20:51 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:20:51 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:20:51 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:20:51 user nova-compute[73503]:   </cpu>
Aug 26 13:20:51 user nova-compute[73503]:   <devices>
Aug 26 13:20:51 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:20:51 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:20:51 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:20:51 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:20:51 user nova-compute[73503]:       <serial>4f637674-bc8a-4cf9-9047-5af7b3e4b6be</serial>
Aug 26 13:20:51 user nova-compute[73503]:     </disk>
Aug 26 13:20:51 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:20:51 user nova-compute[73503]:       <mac address="fa:16:3e:85:0c:88"/>
Aug 26 13:20:51 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:20:51 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:20:51 user nova-compute[73503]:       <target dev="tap4fc22ec9-af"/>
Aug 26 13:20:51 user nova-compute[73503]:     </interface>
Aug 26 13:20:51 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:20:51 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/console.log" append="off"/>
Aug 26 13:20:51 user nova-compute[73503]:     </serial>
Aug 26 13:20:51 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:20:51 user nova-compute[73503]:     <video>
Aug 26 13:20:51 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:20:51 user nova-compute[73503]:     </video>
Aug 26 13:20:51 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:20:51 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:20:51 user nova-compute[73503]:     </rng>
Aug 26 13:20:51 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:20:51 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:20:51 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:20:51 user nova-compute[73503]:     </memballoon>
Aug 26 13:20:51 user nova-compute[73503]:   </devices>
Aug 26 13:20:51 user nova-compute[73503]: </domain>
Aug 26 13:20:51 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934835306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934835306',id=22,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-d0e9400p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:20:33Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=6472acd9-81af-48fe-9650-0cfb8146dbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG os_vif [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fc22ec9-af, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fc22ec9-af, col_values=(('external_ids', {'iface-id': '4fc22ec9-afba-413e-9399-378319124489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:0c:88', 'vm-uuid': '6472acd9-81af-48fe-9650-0cfb8146dbd0'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:51 user nova-compute[73503]: INFO os_vif [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af')
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:20:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No VIF found with MAC fa:16:3e:85:0c:88, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:20:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-c12d8ed5-e41e-4d7b-86df-062c299f7d3d req-a52abecf-60a4-4359-a26b-c1b7012f809f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c12d8ed5-e41e-4d7b-86df-062c299f7d3d req-a52abecf-60a4-4359-a26b-c1b7012f809f service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c12d8ed5-e41e-4d7b-86df-062c299f7d3d req-a52abecf-60a4-4359-a26b-c1b7012f809f service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c12d8ed5-e41e-4d7b-86df-062c299f7d3d req-a52abecf-60a4-4359-a26b-c1b7012f809f service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-c12d8ed5-e41e-4d7b-86df-062c299f7d3d req-a52abecf-60a4-4359-a26b-c1b7012f809f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:53 user nova-compute[73503]: WARNING nova.compute.manager [req-c12d8ed5-e41e-4d7b-86df-062c299f7d3d req-a52abecf-60a4-4359-a26b-c1b7012f809f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state building and task_state spawning.
Aug 26 13:20:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056055.0361695, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Resumed (Lifecycle Event)
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance spawned successfully.
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056055.0400608, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Started (Lifecycle Event)
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-75a95d9f-96e0-41e5-a570-e287375b2ad7 req-9df6a73d-49f1-4723-9cb7-3868969bf8a8 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75a95d9f-96e0-41e5-a570-e287375b2ad7 req-9df6a73d-49f1-4723-9cb7-3868969bf8a8 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75a95d9f-96e0-41e5-a570-e287375b2ad7 req-9df6a73d-49f1-4723-9cb7-3868969bf8a8 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75a95d9f-96e0-41e5-a570-e287375b2ad7 req-9df6a73d-49f1-4723-9cb7-3868969bf8a8 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-75a95d9f-96e0-41e5-a570-e287375b2ad7 req-9df6a73d-49f1-4723-9cb7-3868969bf8a8 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:20:55 user nova-compute[73503]: WARNING nova.compute.manager [req-75a95d9f-96e0-41e5-a570-e287375b2ad7 req-9df6a73d-49f1-4723-9cb7-3868969bf8a8 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state building and task_state spawning.
Aug 26 13:20:55 user nova-compute[73503]: INFO nova.compute.manager [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Took 22.91 seconds to build instance.
Aug 26 13:20:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1853eb40-38a6-40c4-bfca-c61b2cfb2e93 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.078s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:20:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:20:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxGPOAWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:00 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:00 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:00 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629d6ef-ecba-4ac7-b5d5-7252b68d0720]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:21:00 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf91851a-2055-4bbf-9ab2-b7bedfb38abb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893] added
Aug 26 13:21:00 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aa1ed6-c1d4-42b5-a155-68b6d7b8d367]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cd618a-a658-46a4-b72f-dbbe2727f367]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxGPOAWD {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxGPOAWD" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac3452-0909-44fd-8059-c984895eaeab]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxGPOAWD'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ede0bac-21cc-41ba-b316-764720b89206]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca91702-b754-47f6-be64-0b389218e3ed]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:00 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:00 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e8ea4d-e979-4bad-97ec-3fc2e14701aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260]
Aug 26 13:21:00 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260] successful.
Aug 26 13:21:00 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04c8204-1f33-4680-9520-c6032c14ce7c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4d8ec6-60d4-4e0a-9c68-a7931a68cd0c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:00 user nova-compute[73503]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 (non-flash)
Aug 26 13:21:00 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:00 user nova-compute[73503]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 (non-flash)
Aug 26 13:21:00 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe2bb2-0cb3-426f-8ac2-783bef876556]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:21:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxGPOAWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:21:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23239643031303433', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239643031303433', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:21:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'flavor' on Instance uuid 6fb3f5db-a603-4982-8304-c4601a5c5b17 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:21:01 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:21:01 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:21:01 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:21:01 user nova-compute[73503]:   <serial>93c89ff7-22d5-4f15-a4bd-d783a7f29893</serial>
Aug 26 13:21:01 user nova-compute[73503]: </disk>
Aug 26 13:21:01 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:21:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No VIF found with MAC fa:16:3e:e2:79:e7, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-04bb03f7-38be-4cfd-b5cf-17b8efe5faca tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.257s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:03 user nova-compute[73503]: INFO nova.compute.manager [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Terminating instance
Aug 26 13:21:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-6df95111-3e58-4be1-a0ae-da689d2f71b6 req-3db1c654-69e2-47fb-8b06-06f918f16057 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6df95111-3e58-4be1-a0ae-da689d2f71b6 req-3db1c654-69e2-47fb-8b06-06f918f16057 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6df95111-3e58-4be1-a0ae-da689d2f71b6 req-3db1c654-69e2-47fb-8b06-06f918f16057 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6df95111-3e58-4be1-a0ae-da689d2f71b6 req-3db1c654-69e2-47fb-8b06-06f918f16057 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-6df95111-3e58-4be1-a0ae-da689d2f71b6 req-3db1c654-69e2-47fb-8b06-06f918f16057 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-6df95111-3e58-4be1-a0ae-da689d2f71b6 req-3db1c654-69e2-47fb-8b06-06f918f16057 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Instance destroyed successfully.
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'resources' on Instance uuid ab4f580b-7abb-45b1-84fd-79957526124a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:15:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1683915817',display_name='tempest-ServerActionsTestOtherA-server-537947146',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1683915817',id=14,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0FicSYtb+XZMerD16xYzO8q+U3g8rcG5d5MFbKomScizcC0+Fw0fIAVHBROQZJpRPR1Ifo9emWEM9YNTyE+juaAPyhTubC/2jYPI8N8OQIO3i32kDqa2jmMSSw5sG/yA==',key_name='tempest-keypair-1153890614',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-l71x2txa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ab4f580b-7abb-45b1-84fd-79957526124a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "5947525d-216d-4665-9d3c-b7c3deadfb70", "address": "fa:16:3e:cc:2f:32", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5947525d-21", "ovs_interfaceid": "5947525d-216d-4665-9d3c-b7c3deadfb70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG os_vif [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5947525d-21, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: INFO os_vif [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:2f:32,bridge_name='br-int',has_traffic_filtering=True,id=5947525d-216d-4665-9d3c-b7c3deadfb70,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5947525d-21')
Aug 26 13:21:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Deleting instance files /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a_del
Aug 26 13:21:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Deletion of /opt/stack/data/nova/instances/ab4f580b-7abb-45b1-84fd-79957526124a_del complete
Aug 26 13:21:04 user nova-compute[73503]: INFO nova.compute.manager [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 26 13:21:04 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:05 user nova-compute[73503]: INFO nova.compute.manager [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Detaching volume 93c89ff7-22d5-4f15-a4bd-d783a7f29893
Aug 26 13:21:05 user nova-compute[73503]: INFO nova.virt.block_device [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Attempting to driver detach volume 93c89ff7-22d5-4f15-a4bd-d783a7f29893 from mountpoint /dev/vdb
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Attempting to detach device vdb from instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:21:05 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:21:05 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:21:05 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:21:05 user nova-compute[73503]:   <serial>93c89ff7-22d5-4f15-a4bd-d783a7f29893</serial>
Aug 26 13:21:05 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:21:05 user nova-compute[73503]: </disk>
Aug 26 13:21:05 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:21:05 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully detached device vdb from instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 from the persistent domain config.
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:21:05 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:21:05 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:21:05 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:21:05 user nova-compute[73503]:   <serial>93c89ff7-22d5-4f15-a4bd-d783a7f29893</serial>
Aug 26 13:21:05 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:21:05 user nova-compute[73503]: </disk>
Aug 26 13:21:05 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:05 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Took 1.10 seconds to deallocate network for instance.
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-a3091c21-f241-411c-9889-4c4cc7a6b53f req-04f3bba6-357b-4493-bec2-b8f8b1c508a6 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-deleted-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:05 user nova-compute[73503]: INFO nova.compute.manager [req-a3091c21-f241-411c-9889-4c4cc7a6b53f req-04f3bba6-357b-4493-bec2-b8f8b1c508a6 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Neutron deleted interface 5947525d-216d-4665-9d3c-b7c3deadfb70; detaching it from the instance and deleting it from the info cache
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-a3091c21-f241-411c-9889-4c4cc7a6b53f req-04f3bba6-357b-4493-bec2-b8f8b1c508a6 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-a3091c21-f241-411c-9889-4c4cc7a6b53f req-04f3bba6-357b-4493-bec2-b8f8b1c508a6 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Detach interface failed, port_id=5947525d-216d-4665-9d3c-b7c3deadfb70, reason: Instance ab4f580b-7abb-45b1-84fd-79957526124a could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056065.9642687, 6fb3f5db-a603-4982-8304-c4601a5c5b17 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:21:05 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully detached device vdb from instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 from the live domain config.
Aug 26 13:21:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxGPOAWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:05 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:21:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f61fbe-2497-4271-979b-0140a763e3cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e0f43-43f5-4882-9a60-267870fc9805]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:06 user nova-compute[73503]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 (non-flash)
Aug 26 13:21:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:06 user nova-compute[73503]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 (non-flash)
Aug 26 13:21:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd314242680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3117ce7-0412-469e-95d9-ee9d7bcd4e7c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5960082b-b708-444b-a6ec-7d6c2ab61b57]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[01329ae1-1304-4dda-a432-052814ad6d1f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8638921-2795-4eb2-872d-617d99b41dcf]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d5a62-1c53-4a78-97d8-089bf6e87d4e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:06 user nova-compute[73503]: WARNING nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state deleted and task_state None.
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:06 user nova-compute[73503]: WARNING nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state deleted and task_state None.
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:06 user nova-compute[73503]: WARNING nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state deleted and task_state None.
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:06 user nova-compute[73503]: WARNING nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-unplugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state deleted and task_state None.
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Acquiring lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] Lock "ab4f580b-7abb-45b1-84fd-79957526124a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] No waiting events found dispatching network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:06 user nova-compute[73503]: WARNING nova.compute.manager [req-22b7c893-1bc8-45b2-bcf5-90412f56e782 req-40fc4fc8-6051-48db-8cf9-d9144fa4d636 service nova] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Received unexpected event network-vif-plugged-5947525d-216d-4665-9d3c-b7c3deadfb70 for instance with vm_state deleted and task_state None.
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a566374b-ed79-402d-aa6b-3a05b2d51e34]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260]
Aug 26 13:21:06 user nova-compute[73503]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893, portal: 172.16.0.220,3260] successful.
Aug 26 13:21:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93c89ff7-22d5-4f15-a4bd-d783a7f29893 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b631b-6d97-455f-a153-2c36a936e2b3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] <== disconnect_volume: return (310ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Deleted allocations for instance ab4f580b-7abb-45b1-84fd-79957526124a
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbff2c05-25d9-46bc-b565-44e3b26ef586 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ab4f580b-7abb-45b1-84fd-79957526124a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:06 user nova-compute[73503]: INFO nova.compute.manager [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Unshelving
Aug 26 13:21:06 user nova-compute[73503]: INFO nova.virt.block_device [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Booting with volume 2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb at /dev/vdc
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.utils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db32d08-1171-4941-a65a-3eb3fbf69ba0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade1d24-445f-47a5-8f86-b83abeec1691]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1ce4e0-9f62-417c-930b-d69c6e21ed88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2344e-89aa-4940-9ead-4e0b321ef126]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:21:06 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:21:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[446dfef5-13f1-41cc-afd3-6f11f2a1d75c]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG os_brick.utils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:06 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating existing volume attachment record: 4aa6b4d8-7fdb-4b64-ae05-7e865aac883c {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:21:07 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'flavor' on Instance uuid 6fb3f5db-a603-4982-8304-c4601a5c5b17 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eab8972-7dc5-4284-b8c6-64f5cbc645c4 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.153s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:07 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:21:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:21:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:21:13 user nova-compute[73503]: INFO nova.compute.claims [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Claim successful on node user
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:21:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:21:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Creating image(s)
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.policy [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6390e5b4c64754ab6f14217f4da833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8314eb6dec444ea31e9685d11b2fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:21:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk 1073741824" returned: 0 in 0.047s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Successfully created port: 8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Cannot resize image /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Ensure instance console log exists: /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Successfully updated port: 8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquired lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-changed-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Refreshing instance network info cache due to event network-changed-8d4a2ae9-81c6-46c2-b949-749cb1976f32. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] Acquiring lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating instance_info_cache with network_info: [{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Releasing lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance network_info: |[{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] Acquired lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Refreshing network info cache for port 8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start _get_guest_xml network_info=[{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:21:16 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:16 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.objects.instance [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'pci_devices' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:21:16 user nova-compute[73503]:   <uuid>da1fecf0-ecdf-4e5a-91c5-b83676d953ec</uuid>
Aug 26 13:21:16 user nova-compute[73503]:   <name>instance-00000017</name>
Aug 26 13:21:16 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:21:16 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:21:16 user nova-compute[73503]:   <metadata>
Aug 26 13:21:16 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:21:16 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:21:16 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeTestJSON-server-236484995</nova:name>
Aug 26 13:21:16 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:21:16</nova:creationTime>
Aug 26 13:21:16 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:21:16 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:21:16 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:21:16 user nova-compute[73503]:       <nova:owner>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:user uuid="ad6390e5b4c64754ab6f14217f4da833">tempest-AttachVolumeTestJSON-1183738962-project-member</nova:user>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:project uuid="2c8314eb6dec444ea31e9685d11b2fac">tempest-AttachVolumeTestJSON-1183738962</nova:project>
Aug 26 13:21:16 user nova-compute[73503]:       </nova:owner>
Aug 26 13:21:16 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:21:16 user nova-compute[73503]:       <nova:ports>
Aug 26 13:21:16 user nova-compute[73503]:         <nova:port uuid="8d4a2ae9-81c6-46c2-b949-749cb1976f32">
Aug 26 13:21:16 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:21:16 user nova-compute[73503]:         </nova:port>
Aug 26 13:21:16 user nova-compute[73503]:       </nova:ports>
Aug 26 13:21:16 user nova-compute[73503]:     </nova:instance>
Aug 26 13:21:16 user nova-compute[73503]:   </metadata>
Aug 26 13:21:16 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:21:16 user nova-compute[73503]:     <system>
Aug 26 13:21:16 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:21:16 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:21:16 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:21:16 user nova-compute[73503]:       <entry name="serial">da1fecf0-ecdf-4e5a-91c5-b83676d953ec</entry>
Aug 26 13:21:16 user nova-compute[73503]:       <entry name="uuid">da1fecf0-ecdf-4e5a-91c5-b83676d953ec</entry>
Aug 26 13:21:16 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:21:16 user nova-compute[73503]:     </system>
Aug 26 13:21:16 user nova-compute[73503]:   </sysinfo>
Aug 26 13:21:16 user nova-compute[73503]:   <os>
Aug 26 13:21:16 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:21:16 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:21:16 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:21:16 user nova-compute[73503]:   </os>
Aug 26 13:21:16 user nova-compute[73503]:   <features>
Aug 26 13:21:16 user nova-compute[73503]:     <acpi/>
Aug 26 13:21:16 user nova-compute[73503]:     <apic/>
Aug 26 13:21:16 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:21:16 user nova-compute[73503]:   </features>
Aug 26 13:21:16 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:21:16 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:21:16 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:21:16 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:21:16 user nova-compute[73503]:   </clock>
Aug 26 13:21:16 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:21:16 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:21:16 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:21:16 user nova-compute[73503]:   </cpu>
Aug 26 13:21:16 user nova-compute[73503]:   <devices>
Aug 26 13:21:16 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:21:16 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:21:16 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk"/>
Aug 26 13:21:16 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:21:16 user nova-compute[73503]:     </disk>
Aug 26 13:21:16 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:21:16 user nova-compute[73503]:       <mac address="fa:16:3e:89:cd:85"/>
Aug 26 13:21:16 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:16 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:21:16 user nova-compute[73503]:       <target dev="tap8d4a2ae9-81"/>
Aug 26 13:21:16 user nova-compute[73503]:     </interface>
Aug 26 13:21:16 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:21:16 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/console.log" append="off"/>
Aug 26 13:21:16 user nova-compute[73503]:     </serial>
Aug 26 13:21:16 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:21:16 user nova-compute[73503]:     <video>
Aug 26 13:21:16 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:16 user nova-compute[73503]:     </video>
Aug 26 13:21:16 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:21:16 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:21:16 user nova-compute[73503]:     </rng>
Aug 26 13:21:16 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:21:16 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:21:16 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:21:16 user nova-compute[73503]:     </memballoon>
Aug 26 13:21:16 user nova-compute[73503]:   </devices>
Aug 26 13:21:16 user nova-compute[73503]: </domain>
Aug 26 13:21:16 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG os_vif [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d4a2ae9-81, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d4a2ae9-81, col_values=(('external_ids', {'iface-id': '8d4a2ae9-81c6-46c2-b949-749cb1976f32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:cd:85', 'vm-uuid': 'da1fecf0-ecdf-4e5a-91c5-b83676d953ec'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:16 user nova-compute[73503]: INFO os_vif [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81')
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No VIF found with MAC fa:16:3e:89:cd:85, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG nova.network.neutron [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updated VIF entry in instance network info cache for port 8d4a2ae9-81c6-46c2-b949-749cb1976f32. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG nova.network.neutron [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating instance_info_cache with network_info: [{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-df6801f4-7b22-45b5-aa82-f4675c7f6961 req-7b9b21d5-7b09-42f5-9818-9b1faf5227e1 service nova] Releasing lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056080.6033282, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Resumed (Lifecycle Event)
Aug 26 13:21:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056064.5604568, ab4f580b-7abb-45b1-84fd-79957526124a => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] VM Stopped (Lifecycle Event)
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-dd541d01-4c03-4128-82cf-d989f16865ca req-7959c3ce-2d28-4651-91e9-3d022c7b7b35 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dd541d01-4c03-4128-82cf-d989f16865ca req-7959c3ce-2d28-4651-91e9-3d022c7b7b35 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dd541d01-4c03-4128-82cf-d989f16865ca req-7959c3ce-2d28-4651-91e9-3d022c7b7b35 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dd541d01-4c03-4128-82cf-d989f16865ca req-7959c3ce-2d28-4651-91e9-3d022c7b7b35 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-dd541d01-4c03-4128-82cf-d989f16865ca req-7959c3ce-2d28-4651-91e9-3d022c7b7b35 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:20 user nova-compute[73503]: WARNING nova.compute.manager [req-dd541d01-4c03-4128-82cf-d989f16865ca req-7959c3ce-2d28-4651-91e9-3d022c7b7b35 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state building and task_state spawning.
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-61060a9c-9438-4474-9db9-91d12fc2e840 req-bd9daa92-2967-4c7a-858f-5901192874aa service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-61060a9c-9438-4474-9db9-91d12fc2e840 req-bd9daa92-2967-4c7a-858f-5901192874aa service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-61060a9c-9438-4474-9db9-91d12fc2e840 req-bd9daa92-2967-4c7a-858f-5901192874aa service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-61060a9c-9438-4474-9db9-91d12fc2e840 req-bd9daa92-2967-4c7a-858f-5901192874aa service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-61060a9c-9438-4474-9db9-91d12fc2e840 req-bd9daa92-2967-4c7a-858f-5901192874aa service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:20 user nova-compute[73503]: WARNING nova.compute.manager [req-61060a9c-9438-4474-9db9-91d12fc2e840 req-bd9daa92-2967-4c7a-858f-5901192874aa service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state building and task_state spawning.
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-bf929fa1-60d3-4edd-b9a3-157f1f2a8423 None None] [instance: ab4f580b-7abb-45b1-84fd-79957526124a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:20 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:20 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=25.289379119873047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance spawned successfully.
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056080.6048927, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Started (Lifecycle Event)
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:21:20 user nova-compute[73503]: INFO nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:20 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance de9a2cdb-bee4-4901-8dac-34ca47682cdf has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:21:21 user nova-compute[73503]: INFO nova.compute.manager [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Took 7.28 seconds to build instance.
Aug 26 13:21:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-199d418d-042a-4e35-8b67-07e192b6ebb3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.388s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.562s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'pci_requests' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'numa_topology' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:21:21 user nova-compute[73503]: INFO nova.compute.claims [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Claim successful on node user
Aug 26 13:21:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:21:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:22 user nova-compute[73503]: INFO nova.network.neutron [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating port 5bf4353b-4c31-4fe2-928b-b765212e20d5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 13:21:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:21:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:21:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-changed-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Refreshing instance network info cache due to event network-changed-5bf4353b-4c31-4fe2-928b-b765212e20d5. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:21:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Creating image(s)
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'trusted_certs' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.network.neutron [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Refreshing network info cache for port 5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG nova.objects.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<de9a2cdb-bee4-4901-8dac-34ca47682cdf> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "106c7ccdc1d8a365d59a19fda8a083932eee5d21" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "106c7ccdc1d8a365d59a19fda8a083932eee5d21" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.part --force-share --output=json" returned: 0 in 0.259s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.virt.images [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] 1ce19902-5575-4e90-a163-1f7fb0151786 was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.part /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.part /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.converted" returned: 0 in 0.276s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updated VIF entry in instance network info cache for port 5bf4353b-4c31-4fe2-928b-b765212e20d5. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0209dbc4-5741-47ce-b5d6-ae25d50a5726 req-8506b99d-d078-4599-9721-03fc23561e86 service nova] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-changed-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Refreshing instance network info cache due to event network-changed-161e50eb-2232-4f63-bb55-c642cb4db883. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] Acquiring lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] Acquired lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Refreshing network info cache for port 161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "106c7ccdc1d8a365d59a19fda8a083932eee5d21" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.870s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 --force-share --output=json" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "106c7ccdc1d8a365d59a19fda8a083932eee5d21" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "106c7ccdc1d8a365d59a19fda8a083932eee5d21" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21,backing_fmt=raw /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21,backing_fmt=raw /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk 1073741824" returned: 0 in 0.048s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "106c7ccdc1d8a365d59a19fda8a083932eee5d21" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updated VIF entry in instance network info cache for port 161e50eb-2232-4f63-bb55-c642cb4db883. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1039c3a4-1c73-41b3-b305-4fe65d0b0253 req-fb457cea-ed09-45d0-9e1f-0ccabb2e946c service nova] Releasing lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG nova.objects.instance [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'migration_context' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG nova.objects.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<de9a2cdb-bee4-4901-8dac-34ca47682cdf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Rebasing disk image.
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b -F raw /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "interface-2a4aee9a-2301-4f73-a1fa-479dfc57893b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "interface-2a4aee9a-2301-4f73-a1fa-479dfc57893b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'flavor' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'pci_requests' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG nova.objects.base [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Object Instance<2a4aee9a-2301-4f73-a1fa-479dfc57893b> lazy-loaded attributes: flavor,pci_requests {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:21:27 user nova-compute[73503]: DEBUG nova.policy [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd620945d8b4acabdf767d34fe696f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8b69eae5d6f48968913dc31408311bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:21:28 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Successfully created port: c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b -F raw /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk" returned: 0 in 2.742s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Ensure instance console log exists: /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Start _get_guest_xml network_info=[{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b4d10c802c438d0876939e950a3a13c9',container_format='bare',created_at=2023-08-26T13:19:13Z,direct_url=<?>,disk_format='qcow2',id=1ce19902-5575-4e90-a163-1f7fb0151786,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1766659861-shelved',owner='b92392a06d1e41d49af47410121fabc0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T13:19:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNYsekUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'de9a2cdb-bee4-4901-8dac-34ca47682cdf', 'attached_at': '', 'detached_at': '', 'volume_id': '2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb', 'serial': '2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb'}, 'attachment_id': '4aa6b4d8-7fdb-4b64-ae05-7e865aac883c', 'boot_index': None, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:21:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b4d10c802c438d0876939e950a3a13c9',container_format='bare',created_at=2023-08-26T13:19:13Z,direct_url=<?>,disk_format='qcow2',id=1ce19902-5575-4e90-a163-1f7fb0151786,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1766659861-shelved',owner='b92392a06d1e41d49af47410121fabc0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T13:19:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.objects.instance [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'vcpu_model' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.objects.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<de9a2cdb-bee4-4901-8dac-34ca47682cdf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNYsekUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:29 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:29 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:29 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec294a6-54c3-4b60-976b-37e0de04f16e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:21:29 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5180e1-d878-46d4-8b03-b2737d708fed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb] added
Aug 26 13:21:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a0908-b2df-4091-8886-146904c3e908]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[61266f1b-ad21-4e56-a953-62d0b7dc47ab]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNYsekUx {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LNYsekUx" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb24f3c-6807-4ac9-9afb-6afc67c4327c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LNYsekUx'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc8288-49ad-4391-987a-171d4b90fcce]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e99819-5622-4215-b845-639dbce94739]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cced0b-468d-4c43-a451-a46be0d385c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260]
Aug 26 13:21:29 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260] successful.
Aug 26 13:21:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9cd0aa-1fbe-4f32-bc93-78926c7f346b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabce130-1c30-40c0-a6bb-11daf51116ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:29 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:29 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:21:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Successfully updated port: c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f07728-ee70-48de-b43a-65ebd03d5205]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquired lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-changed-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Refreshing instance network info cache due to event network-changed-c848f28c-0fb9-417b-aee3-02d95a293561. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] Acquiring lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNYsekUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23234323662626634', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234323662626634', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1766659861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1766659861',id=17,image_ref='1ce19902-5575-4e90-a163-1f7fb0151786',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1321173568',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-jthfuhzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member',shelved_at='2023-08-26T13:19:19.529522',shelved_host='user',shelved_image_id='1ce19902-5575-4e90-a163-1f7fb0151786'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=de9a2cdb-bee4-4901-8dac-34ca47682cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.objects.instance [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'pci_devices' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.objects.base [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<de9a2cdb-bee4-4901-8dac-34ca47682cdf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:21:31 user nova-compute[73503]:   <uuid>de9a2cdb-bee4-4901-8dac-34ca47682cdf</uuid>
Aug 26 13:21:31 user nova-compute[73503]:   <name>instance-00000011</name>
Aug 26 13:21:31 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:21:31 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:21:31 user nova-compute[73503]:   <metadata>
Aug 26 13:21:31 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:21:31 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:21:31 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1766659861</nova:name>
Aug 26 13:21:31 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:21:29</nova:creationTime>
Aug 26 13:21:31 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:21:31 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:21:31 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:21:31 user nova-compute[73503]:       <nova:owner>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:user uuid="ad99f2e83e814a07a9f41d00b6bcecde">tempest-AttachVolumeShelveTestJSON-568979141-project-member</nova:user>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:project uuid="b92392a06d1e41d49af47410121fabc0">tempest-AttachVolumeShelveTestJSON-568979141</nova:project>
Aug 26 13:21:31 user nova-compute[73503]:       </nova:owner>
Aug 26 13:21:31 user nova-compute[73503]:       <nova:root type="image" uuid="1ce19902-5575-4e90-a163-1f7fb0151786"/>
Aug 26 13:21:31 user nova-compute[73503]:       <nova:ports>
Aug 26 13:21:31 user nova-compute[73503]:         <nova:port uuid="5bf4353b-4c31-4fe2-928b-b765212e20d5">
Aug 26 13:21:31 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:21:31 user nova-compute[73503]:         </nova:port>
Aug 26 13:21:31 user nova-compute[73503]:       </nova:ports>
Aug 26 13:21:31 user nova-compute[73503]:     </nova:instance>
Aug 26 13:21:31 user nova-compute[73503]:   </metadata>
Aug 26 13:21:31 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:21:31 user nova-compute[73503]:     <system>
Aug 26 13:21:31 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:21:31 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:21:31 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:21:31 user nova-compute[73503]:       <entry name="serial">de9a2cdb-bee4-4901-8dac-34ca47682cdf</entry>
Aug 26 13:21:31 user nova-compute[73503]:       <entry name="uuid">de9a2cdb-bee4-4901-8dac-34ca47682cdf</entry>
Aug 26 13:21:31 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:21:31 user nova-compute[73503]:     </system>
Aug 26 13:21:31 user nova-compute[73503]:   </sysinfo>
Aug 26 13:21:31 user nova-compute[73503]:   <os>
Aug 26 13:21:31 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:21:31 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:21:31 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:21:31 user nova-compute[73503]:   </os>
Aug 26 13:21:31 user nova-compute[73503]:   <features>
Aug 26 13:21:31 user nova-compute[73503]:     <acpi/>
Aug 26 13:21:31 user nova-compute[73503]:     <apic/>
Aug 26 13:21:31 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:21:31 user nova-compute[73503]:   </features>
Aug 26 13:21:31 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:21:31 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:21:31 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:21:31 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:21:31 user nova-compute[73503]:   </clock>
Aug 26 13:21:31 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:21:31 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:21:31 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:21:31 user nova-compute[73503]:   </cpu>
Aug 26 13:21:31 user nova-compute[73503]:   <devices>
Aug 26 13:21:31 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:21:31 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:21:31 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk"/>
Aug 26 13:21:31 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:21:31 user nova-compute[73503]:     </disk>
Aug 26 13:21:31 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:21:31 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:21:31 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:21:31 user nova-compute[73503]:       <target dev="vdc" bus="virtio"/>
Aug 26 13:21:31 user nova-compute[73503]:       <serial>2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb</serial>
Aug 26 13:21:31 user nova-compute[73503]:     </disk>
Aug 26 13:21:31 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:21:31 user nova-compute[73503]:       <mac address="fa:16:3e:2d:10:f0"/>
Aug 26 13:21:31 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:31 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:21:31 user nova-compute[73503]:       <target dev="tap5bf4353b-4c"/>
Aug 26 13:21:31 user nova-compute[73503]:     </interface>
Aug 26 13:21:31 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:21:31 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/console.log" append="off"/>
Aug 26 13:21:31 user nova-compute[73503]:     </serial>
Aug 26 13:21:31 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:21:31 user nova-compute[73503]:     <video>
Aug 26 13:21:31 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:31 user nova-compute[73503]:     </video>
Aug 26 13:21:31 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:21:31 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:21:31 user nova-compute[73503]:     </rng>
Aug 26 13:21:31 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:21:31 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:21:31 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:21:31 user nova-compute[73503]:     </memballoon>
Aug 26 13:21:31 user nova-compute[73503]:   </devices>
Aug 26 13:21:31 user nova-compute[73503]: </domain>
Aug 26 13:21:31 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1766659861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1766659861',id=17,image_ref='1ce19902-5575-4e90-a163-1f7fb0151786',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1321173568',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-jthfuhzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member',shelved_at='2023-08-26T13:19:19.529522',shelved_host='user',shelved_image_id='1ce19902-5575-4e90-a163-1f7fb0151786'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=de9a2cdb-bee4-4901-8dac-34ca47682cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG os_vif [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bf4353b-4c, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bf4353b-4c, col_values=(('external_ids', {'iface-id': '5bf4353b-4c31-4fe2-928b-b765212e20d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:10:f0', 'vm-uuid': 'de9a2cdb-bee4-4901-8dac-34ca47682cdf'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: INFO os_vif [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c')
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Releasing lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] Acquired lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Refreshing network info cache for port c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG os_vif [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc848f28c-0f, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc848f28c-0f, col_values=(('external_ids', {'iface-id': 'c848f28c-0fb9-417b-aee3-02d95a293561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:1c:8f', 'vm-uuid': '2a4aee9a-2301-4f73-a1fa-479dfc57893b'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: INFO os_vif [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f')
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] attach device xml: <interface type="ethernet">
Aug 26 13:21:31 user nova-compute[73503]:   <mac address="fa:16:3e:af:1c:8f"/>
Aug 26 13:21:31 user nova-compute[73503]:   <model type="virtio"/>
Aug 26 13:21:31 user nova-compute[73503]:   <mtu size="1442"/>
Aug 26 13:21:31 user nova-compute[73503]:   <target dev="tapc848f28c-0f"/>
Aug 26 13:21:31 user nova-compute[73503]: </interface>
Aug 26 13:21:31 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No VIF found with MAC fa:16:3e:2d:10:f0, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing instance network info cache due to event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.objects.instance [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'flavor' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No BDM found with device name hda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No VIF found with MAC fa:16:3e:0e:a6:5c, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:21:32 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:21:32 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:21:32 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:21:32</nova:creationTime>
Aug 26 13:21:32 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:21:32 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:21:32 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:21:32 user nova-compute[73503]:   <nova:owner>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:21:32 user nova-compute[73503]:   </nova:owner>
Aug 26 13:21:32 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:21:32 user nova-compute[73503]:   <nova:ports>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:21:32 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:21:32 user nova-compute[73503]:     </nova:port>
Aug 26 13:21:32 user nova-compute[73503]:     <nova:port uuid="c848f28c-0fb9-417b-aee3-02d95a293561">
Aug 26 13:21:32 user nova-compute[73503]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Aug 26 13:21:32 user nova-compute[73503]:     </nova:port>
Aug 26 13:21:32 user nova-compute[73503]:   </nova:ports>
Aug 26 13:21:32 user nova-compute[73503]: </nova:instance>
Aug 26 13:21:32 user nova-compute[73503]:  {{(pid=73503) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d00483a3-366b-4441-8294-5324c95fefe6 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "interface-2a4aee9a-2301-4f73-a1fa-479dfc57893b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.592s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:32 user nova-compute[73503]: INFO nova.compute.manager [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Attaching volume 80a37ad7-c57d-42dc-9d55-fdb1a58305cb to /dev/vdb
Aug 26 13:21:32 user nova-compute[73503]: DEBUG os_brick.utils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff14bebc-e429-4134-bcdc-541d6e847c31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7811ec0-429c-4cc2-995f-5dfa0b765c9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6769a6dd-3883-45ce-9e29-70b947498bb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c708de88-d70d-46bb-b0c0-268e49f78173]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG nova.network.neutron [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updated VIF entry in instance network info cache for port c848f28c-0fb9-417b-aee3-02d95a293561. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG nova.network.neutron [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-964e9163-50d4-4687-a4c5-50794d274fce req-c26c5a2f-2f3a-41dc-8f21-358db29b5cb6 service nova] Releasing lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:21:32 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:21:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7aacd5-fcb3-4ae1-9356-5cff7c769272]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG os_brick.utils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating existing volume attachment record: 14afbf27-4b6e-4988-9d51-6466ecc23dce {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.network.neutron [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updated VIF entry in instance network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.network.neutron [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8036bb04-dd63-4577-836f-5c1db641f9e1 req-8cb24394-aff0-40f9-8709-9eafd79dda42 service nova] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.objects.instance [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'flavor' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:33 user nova-compute[73503]: WARNING nova.compute.manager [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 for instance with vm_state active and task_state None.
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:33 user nova-compute[73503]: WARNING nova.compute.manager [req-772f15f6-8498-4dfd-b7e5-79b743e31464 req-78b469c1-dc63-4c1a-8ae5-aa550808e2db service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 for instance with vm_state active and task_state None.
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:33 user nova-compute[73503]: INFO nova.compute.manager [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Attaching volume 7eb2db81-3714-41f6-ba14-37a8a7fd035d to /dev/vdb
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-b6760588-e293-4a12-9467-01feda079f11 req-1797c5d8-bb61-4416-84c1-66ae30ccf60f service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b6760588-e293-4a12-9467-01feda079f11 req-1797c5d8-bb61-4416-84c1-66ae30ccf60f service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b6760588-e293-4a12-9467-01feda079f11 req-1797c5d8-bb61-4416-84c1-66ae30ccf60f service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b6760588-e293-4a12-9467-01feda079f11 req-1797c5d8-bb61-4416-84c1-66ae30ccf60f service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-b6760588-e293-4a12-9467-01feda079f11 req-1797c5d8-bb61-4416-84c1-66ae30ccf60f service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:33 user nova-compute[73503]: WARNING nova.compute.manager [req-b6760588-e293-4a12-9467-01feda079f11 req-1797c5d8-bb61-4416-84c1-66ae30ccf60f service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 13:21:33 user nova-compute[73503]: DEBUG os_brick.utils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b84ff16-ce38-4550-b09a-f059c9546cf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5fd208-78f6-4dfc-b30d-5293dacb947a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d1450-e797-4d32-9e17-c5b7a9a7609e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5061df3-14cc-4f98-889d-0c552a17aa38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:21:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:21:34 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:21:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaba83a3-3fac-4df9-bb5a-4fc6a2095934]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG os_brick.utils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating existing volume attachment record: 073d15d3-720b-4957-bd68-2b80ecda910a {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-958f5187-7eed-4d0b-8ee7-e6222e2bb4db req-7cef208e-22f0-4e29-a7b7-15af0c4abbaf service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-958f5187-7eed-4d0b-8ee7-e6222e2bb4db req-7cef208e-22f0-4e29-a7b7-15af0c4abbaf service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-958f5187-7eed-4d0b-8ee7-e6222e2bb4db req-7cef208e-22f0-4e29-a7b7-15af0c4abbaf service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-958f5187-7eed-4d0b-8ee7-e6222e2bb4db req-7cef208e-22f0-4e29-a7b7-15af0c4abbaf service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-958f5187-7eed-4d0b-8ee7-e6222e2bb4db req-7cef208e-22f0-4e29-a7b7-15af0c4abbaf service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:35 user nova-compute[73503]: WARNING nova.compute.manager [req-958f5187-7eed-4d0b-8ee7-e6222e2bb4db req-7cef208e-22f0-4e29-a7b7-15af0c4abbaf service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056095.857787, de9a2cdb-bee4-4901-8dac-34ca47682cdf => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:35 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] VM Resumed (Lifecycle Event)
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:21:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance spawned successfully.
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:35 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056095.8598294, de9a2cdb-bee4-4901-8dac-34ca47682cdf => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:35 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] VM Started (Lifecycle Event)
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:35 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:21:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-557183dd-1fd6-4dfd-91a3-adfb2e3884a5 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.614s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:21:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:21:44 user nova-compute[73503]: INFO nova.compute.claims [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Claim successful on node user
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:21:45 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJOQbVdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:45 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:45 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:45 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47fe689-8687-461a-9b49-abbc9830b0c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:21:45 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae9f20-4911-498a-b31b-568b76497854]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb] added
Aug 26 13:21:45 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[788a53db-44c0-4c3b-92d7-a27b4caa43eb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc15657-9676-4199-a9a1-8a394d4d4e5b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.policy [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8239f95979394225b8c80579a8121631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e80f2c62e0a4494816b02e60073bb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJOQbVdZ {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rJOQbVdZ" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe2eade-610f-4b4b-81a8-047a91f27e05]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rJOQbVdZ'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4527ee-3772-4edb-933b-27a41c6705f0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:21:45 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Creating image(s)
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "/opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5073662d-267e-4056-b25c-7bc2494dc58e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:45 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:45 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:45 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:45 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858f022-9698-4f0f-b153-a59cd97c9724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260]
Aug 26 13:21:45 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260] successful.
Aug 26 13:21:45 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f51b0-dbc5-4d1b-81cc-44405357234d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6451e0c9-a0ab-495a-bc4f-f74b14810615]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:45 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:45 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:21:45 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:45 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:45 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:21:45 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c0e85-9aaa-40ad-9529-3d69605d813f]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJOQbVdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.274s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk 1073741824" returned: 0 in 0.052s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Successfully created port: 01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Cannot resize image /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Ensure instance console log exists: /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26138303237316365', 'path': '/dev/sdd'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138303237316365', 'path': '/dev/sdd'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.objects.instance [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'flavor' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:21:46 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:21:46 user nova-compute[73503]:   <source dev="/dev/sdd"/>
Aug 26 13:21:46 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:21:46 user nova-compute[73503]:   <serial>80a37ad7-c57d-42dc-9d55-fdb1a58305cb</serial>
Aug 26 13:21:46 user nova-compute[73503]: </disk>
Aug 26 13:21:46 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Successfully updated port: 01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquired lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-changed-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Refreshing instance network info cache due to event network-changed-01caaa96-2fd2-4f7b-9089-29ba2c607ff1. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] Acquiring lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:14:4c:4d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fbec7f8b-4ad4-4b54-bf54-2e0980b86c8a tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.287s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updating instance_info_cache with network_info: [{"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Releasing lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Instance network_info: |[{"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] Acquired lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.neutron [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Refreshing network info cache for port 01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Start _get_guest_xml network_info=[{"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:21:47 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:47 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1763346596',display_name='tempest-AttachVolumeNegativeTest-server-1763346596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1763346596',id=24,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQgB2/40Fk1VB+VvWu/sRsB5M7HTgeHby31o019bfTMFKGSz4898YrQt1tYbDxhkjlVP/rDcAu8KeqCEp1Kb7PaLGSrqbbSrsEphGGOTivVL2gn+xMRIFSQtZ0u3CAq0w==',key_name='tempest-keypair-1931940153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-uv0yxtig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=90c4814c-43f2-454f-964b-6179892193c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'pci_devices' on Instance uuid 90c4814c-43f2-454f-964b-6179892193c1 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:21:47 user nova-compute[73503]:   <uuid>90c4814c-43f2-454f-964b-6179892193c1</uuid>
Aug 26 13:21:47 user nova-compute[73503]:   <name>instance-00000018</name>
Aug 26 13:21:47 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:21:47 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:21:47 user nova-compute[73503]:   <metadata>
Aug 26 13:21:47 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:21:47 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:21:47 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1763346596</nova:name>
Aug 26 13:21:47 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:21:47</nova:creationTime>
Aug 26 13:21:47 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:21:47 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:21:47 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:21:47 user nova-compute[73503]:       <nova:owner>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:user uuid="8239f95979394225b8c80579a8121631">tempest-AttachVolumeNegativeTest-2059589668-project-member</nova:user>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:project uuid="3e80f2c62e0a4494816b02e60073bb0e">tempest-AttachVolumeNegativeTest-2059589668</nova:project>
Aug 26 13:21:47 user nova-compute[73503]:       </nova:owner>
Aug 26 13:21:47 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:21:47 user nova-compute[73503]:       <nova:ports>
Aug 26 13:21:47 user nova-compute[73503]:         <nova:port uuid="01caaa96-2fd2-4f7b-9089-29ba2c607ff1">
Aug 26 13:21:47 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 13:21:47 user nova-compute[73503]:         </nova:port>
Aug 26 13:21:47 user nova-compute[73503]:       </nova:ports>
Aug 26 13:21:47 user nova-compute[73503]:     </nova:instance>
Aug 26 13:21:47 user nova-compute[73503]:   </metadata>
Aug 26 13:21:47 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:21:47 user nova-compute[73503]:     <system>
Aug 26 13:21:47 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:21:47 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:21:47 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:21:47 user nova-compute[73503]:       <entry name="serial">90c4814c-43f2-454f-964b-6179892193c1</entry>
Aug 26 13:21:47 user nova-compute[73503]:       <entry name="uuid">90c4814c-43f2-454f-964b-6179892193c1</entry>
Aug 26 13:21:47 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:21:47 user nova-compute[73503]:     </system>
Aug 26 13:21:47 user nova-compute[73503]:   </sysinfo>
Aug 26 13:21:47 user nova-compute[73503]:   <os>
Aug 26 13:21:47 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:21:47 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:21:47 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:21:47 user nova-compute[73503]:   </os>
Aug 26 13:21:47 user nova-compute[73503]:   <features>
Aug 26 13:21:47 user nova-compute[73503]:     <acpi/>
Aug 26 13:21:47 user nova-compute[73503]:     <apic/>
Aug 26 13:21:47 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:21:47 user nova-compute[73503]:   </features>
Aug 26 13:21:47 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:21:47 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:21:47 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:21:47 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:21:47 user nova-compute[73503]:   </clock>
Aug 26 13:21:47 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:21:47 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:21:47 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:21:47 user nova-compute[73503]:   </cpu>
Aug 26 13:21:47 user nova-compute[73503]:   <devices>
Aug 26 13:21:47 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:21:47 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:21:47 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk"/>
Aug 26 13:21:47 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:21:47 user nova-compute[73503]:     </disk>
Aug 26 13:21:47 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:21:47 user nova-compute[73503]:       <mac address="fa:16:3e:0a:01:0d"/>
Aug 26 13:21:47 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:47 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:21:47 user nova-compute[73503]:       <target dev="tap01caaa96-2f"/>
Aug 26 13:21:47 user nova-compute[73503]:     </interface>
Aug 26 13:21:47 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:21:47 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/console.log" append="off"/>
Aug 26 13:21:47 user nova-compute[73503]:     </serial>
Aug 26 13:21:47 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:21:47 user nova-compute[73503]:     <video>
Aug 26 13:21:47 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:47 user nova-compute[73503]:     </video>
Aug 26 13:21:47 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:21:47 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:21:47 user nova-compute[73503]:     </rng>
Aug 26 13:21:47 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:21:47 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:21:47 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:21:47 user nova-compute[73503]:     </memballoon>
Aug 26 13:21:47 user nova-compute[73503]:   </devices>
Aug 26 13:21:47 user nova-compute[73503]: </domain>
Aug 26 13:21:47 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1763346596',display_name='tempest-AttachVolumeNegativeTest-server-1763346596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1763346596',id=24,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQgB2/40Fk1VB+VvWu/sRsB5M7HTgeHby31o019bfTMFKGSz4898YrQt1tYbDxhkjlVP/rDcAu8KeqCEp1Kb7PaLGSrqbbSrsEphGGOTivVL2gn+xMRIFSQtZ0u3CAq0w==',key_name='tempest-keypair-1931940153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-uv0yxtig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=90c4814c-43f2-454f-964b-6179892193c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG os_vif [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01caaa96-2f, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01caaa96-2f, col_values=(('external_ids', {'iface-id': '01caaa96-2fd2-4f7b-9089-29ba2c607ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:01:0d', 'vm-uuid': '90c4814c-43f2-454f-964b-6179892193c1'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:47 user nova-compute[73503]: INFO os_vif [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f')
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:0a:01:0d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:47 user nova-compute[73503]: INFO nova.compute.manager [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Rescuing
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:21:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updated VIF entry in instance network info cache for port 01caaa96-2fd2-4f7b-9089-29ba2c607ff1. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG nova.network.neutron [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updating instance_info_cache with network_info: [{"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b2cf6fe6-4169-4dc1-b589-82e7a45789a5 req-499d54c7-9dcb-415d-a374-66e05664dc8d service nova] Releasing lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:49 user nova-compute[73503]: WARNING nova.compute.manager [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state rescuing.
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:49 user nova-compute[73503]: WARNING nova.compute.manager [req-dbe34343-7632-46f2-9137-d38fbc0815e7 req-fec73d5d-ea3c-41b1-96e3-0d2d4a2027e9 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state rescuing.
Aug 26 13:21:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance destroyed successfully.
Aug 26 13:21:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Attempting rescue
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73503) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:21:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Creating image(s)
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue" returned: 0 in 0.067s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'migration_context' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<2a7f4f67-ae12-4760-b45a-77e9cca24132> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Start _get_guest_xml network_info=[{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:14:4c:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'resources' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<2a7f4f67-ae12-4760-b45a-77e9cca24132> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'numa_topology' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<2a7f4f67-ae12-4760-b45a-77e9cca24132> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<2a7f4f67-ae12-4760-b45a-77e9cca24132> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641088509',display_name='tempest-ServerRescueNegativeTestJSON-server-1641088509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641088509',id=21,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnijJTcPmg6p6xLu5FGsmewTPcgK1XPz6UAj41pxPqXBHWR8SDB2XgYe3x2ud0QGgrh/tNcxGSlBI6e81S6cuUDM5GjrCOlp4KqymQt8B3qDguHRHeGysDzpBaKdsG+2w==',key_name='tempest-keypair-1726069367',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-stz3l4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=2a7f4f67-ae12-4760-b45a-77e9cca24132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:14:4c:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "vif_mac": "fa:16:3e:14:4c:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Object Instance<2a7f4f67-ae12-4760-b45a-77e9cca24132> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:21:50 user nova-compute[73503]:   <uuid>2a7f4f67-ae12-4760-b45a-77e9cca24132</uuid>
Aug 26 13:21:50 user nova-compute[73503]:   <name>instance-00000015</name>
Aug 26 13:21:50 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:21:50 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:21:50 user nova-compute[73503]:   <metadata>
Aug 26 13:21:50 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:21:50 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:21:50 user nova-compute[73503]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1641088509</nova:name>
Aug 26 13:21:50 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:21:50</nova:creationTime>
Aug 26 13:21:50 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:21:50 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:21:50 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:21:50 user nova-compute[73503]:       <nova:owner>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:user uuid="9cd5b0cb95ba4c6984a9fe5085c87207">tempest-ServerRescueNegativeTestJSON-993610223-project-member</nova:user>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:project uuid="a84b5b1338f040709bafbe65939ac8e7">tempest-ServerRescueNegativeTestJSON-993610223</nova:project>
Aug 26 13:21:50 user nova-compute[73503]:       </nova:owner>
Aug 26 13:21:50 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:21:50 user nova-compute[73503]:       <nova:ports>
Aug 26 13:21:50 user nova-compute[73503]:         <nova:port uuid="a1b437ed-6a04-4d98-af40-196b0ba33def">
Aug 26 13:21:50 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:21:50 user nova-compute[73503]:         </nova:port>
Aug 26 13:21:50 user nova-compute[73503]:       </nova:ports>
Aug 26 13:21:50 user nova-compute[73503]:     </nova:instance>
Aug 26 13:21:50 user nova-compute[73503]:   </metadata>
Aug 26 13:21:50 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:21:50 user nova-compute[73503]:     <system>
Aug 26 13:21:50 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:21:50 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:21:50 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:21:50 user nova-compute[73503]:       <entry name="serial">2a7f4f67-ae12-4760-b45a-77e9cca24132</entry>
Aug 26 13:21:50 user nova-compute[73503]:       <entry name="uuid">2a7f4f67-ae12-4760-b45a-77e9cca24132</entry>
Aug 26 13:21:50 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:21:50 user nova-compute[73503]:     </system>
Aug 26 13:21:50 user nova-compute[73503]:   </sysinfo>
Aug 26 13:21:50 user nova-compute[73503]:   <os>
Aug 26 13:21:50 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:21:50 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:21:50 user nova-compute[73503]:   </os>
Aug 26 13:21:50 user nova-compute[73503]:   <features>
Aug 26 13:21:50 user nova-compute[73503]:     <acpi/>
Aug 26 13:21:50 user nova-compute[73503]:     <apic/>
Aug 26 13:21:50 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:21:50 user nova-compute[73503]:   </features>
Aug 26 13:21:50 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:21:50 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:21:50 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:21:50 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:21:50 user nova-compute[73503]:   </clock>
Aug 26 13:21:50 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:21:50 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:21:50 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:21:50 user nova-compute[73503]:   </cpu>
Aug 26 13:21:50 user nova-compute[73503]:   <devices>
Aug 26 13:21:50 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:21:50 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:21:50 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue"/>
Aug 26 13:21:50 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:21:50 user nova-compute[73503]:     </disk>
Aug 26 13:21:50 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:21:50 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:21:50 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk"/>
Aug 26 13:21:50 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:21:50 user nova-compute[73503]:     </disk>
Aug 26 13:21:50 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:21:50 user nova-compute[73503]:       <mac address="fa:16:3e:14:4c:4d"/>
Aug 26 13:21:50 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:50 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:21:50 user nova-compute[73503]:       <target dev="tapa1b437ed-6a"/>
Aug 26 13:21:50 user nova-compute[73503]:     </interface>
Aug 26 13:21:50 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:21:50 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/console.log" append="off"/>
Aug 26 13:21:50 user nova-compute[73503]:     </serial>
Aug 26 13:21:50 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:21:50 user nova-compute[73503]:     <video>
Aug 26 13:21:50 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:21:50 user nova-compute[73503]:     </video>
Aug 26 13:21:50 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:21:50 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:21:50 user nova-compute[73503]:     </rng>
Aug 26 13:21:50 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:21:50 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:21:50 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:21:50 user nova-compute[73503]:     </memballoon>
Aug 26 13:21:50 user nova-compute[73503]:   </devices>
Aug 26 13:21:50 user nova-compute[73503]: </domain>
Aug 26 13:21:50 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:21:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance destroyed successfully.
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] No VIF found with MAC fa:16:3e:14:4c:4d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] No waiting events found dispatching network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:51 user nova-compute[73503]: WARNING nova.compute.manager [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received unexpected event network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 for instance with vm_state building and task_state spawning.
Aug 26 13:21:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] No waiting events found dispatching network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:51 user nova-compute[73503]: WARNING nova.compute.manager [req-3a4d5d13-4e1b-4445-b0f7-bad5c9782707 req-f95dcd4d-6450-4995-93e0-2d25b90d5385 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received unexpected event network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 for instance with vm_state building and task_state spawning.
Aug 26 13:21:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056112.060379, 90c4814c-43f2-454f-964b-6179892193c1 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] VM Resumed (Lifecycle Event)
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Instance spawned successfully.
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056112.0607176, 90c4814c-43f2-454f-964b-6179892193c1 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] VM Started (Lifecycle Event)
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Took 6.88 seconds to spawn the instance on the hypervisor.
Aug 26 13:21:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:52 user nova-compute[73503]: INFO nova.compute.manager [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Took 7.84 seconds to build instance.
Aug 26 13:21:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d03c0b2e-3d03-4b4b-bea0-206128ed0a2a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.965s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:53 user nova-compute[73503]: WARNING nova.compute.manager [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state rescuing.
Aug 26 13:21:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:21:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:21:53 user nova-compute[73503]: WARNING nova.compute.manager [req-babf629b-8752-4865-bfd9-24adfe7339b9 req-6bccb4bf-fd06-4ea8-899a-9ef2f07fc172 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state rescuing.
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 2a7f4f67-ae12-4760-b45a-77e9cca24132 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056114.2214825, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:54 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Resumed (Lifecycle Event)
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d58fe6f7-a168-4da7-8fb4-e9fab663bd71 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:54 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056114.2255702, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:21:54 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Started (Lifecycle Event)
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:21:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVdsSqZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:21:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:21:57 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[079855ca-af4f-40d9-83ca-aac2fcc75159]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:21:57 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc51ea1-d58b-4ba1-8061-4d20149fc2d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d] added
Aug 26 13:21:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94af4d3-c86c-4981-a6ed-ef4fa432a4ec]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa26d9-98ae-484b-a362-6f6f97bf52b3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVdsSqZg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVdsSqZg" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6673d764-9eda-4907-863c-f85683fe4647]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVdsSqZg'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0a330a-6be7-409a-ae03-c0a91997b70a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3108f6-5bee-48a8-8271-61e80af90a9b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:57 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:57 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:21:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:57 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:57 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:21:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[308cacf2-97e8-4dfd-ad8c-ed83ac731f91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260]
Aug 26 13:21:58 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260] successful.
Aug 26 13:21:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf3571-5ecb-4a2f-9180-be842777ec64]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[66301d37-a274-4000-be86-d8ff86201fb0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:58 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:58 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:21:58 user nova-compute[73503]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d (non-flash)
Aug 26 13:21:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:21:58 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:21:58 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:21:58 user nova-compute[73503]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d (non-flash)
Aug 26 13:21:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f00e60f-78b7-489b-9c19-1b4ff55cd27c]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:21:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVdsSqZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23662326135646163', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662326135646163', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'flavor' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:21:59 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:21:59 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:21:59 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:21:59 user nova-compute[73503]:   <serial>7eb2db81-3714-41f6-ba14-37a8a7fd035d</serial>
Aug 26 13:21:59 user nova-compute[73503]: </disk>
Aug 26 13:21:59 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No BDM found with device name hda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] No VIF found with MAC fa:16:3e:0e:a6:5c, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:21:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15ba4e2a-674a-4662-b13d-436097f9f3f1 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.144s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:00 user nova-compute[73503]: INFO nova.compute.manager [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Detaching volume 7eb2db81-3714-41f6-ba14-37a8a7fd035d
Aug 26 13:22:00 user nova-compute[73503]: INFO nova.virt.block_device [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Attempting to driver detach volume 7eb2db81-3714-41f6-ba14-37a8a7fd035d from mountpoint /dev/vdb
Aug 26 13:22:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Attempting to detach device vdb from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:22:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:22:00 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:22:00 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:22:00 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:22:00 user nova-compute[73503]:   <serial>7eb2db81-3714-41f6-ba14-37a8a7fd035d</serial>
Aug 26 13:22:00 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 13:22:00 user nova-compute[73503]: </disk>
Aug 26 13:22:00 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:22:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully detached device vdb from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the persistent domain config.
Aug 26 13:22:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:22:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:22:00 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:22:00 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:22:00 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:22:00 user nova-compute[73503]:   <serial>7eb2db81-3714-41f6-ba14-37a8a7fd035d</serial>
Aug 26 13:22:00 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 13:22:00 user nova-compute[73503]: </disk>
Aug 26 13:22:00 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056121.3428926, 2a4aee9a-2301-4f73-a1fa-479dfc57893b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:22:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully detached device vdb from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the live domain config.
Aug 26 13:22:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVdsSqZg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:22:01 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc319b8c-e92f-459b-b65c-829c78c0e70b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c64f036-4ea0-43d1-8dcc-6f1d2d03bb6c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:22:01 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:22:01 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:22:01 user nova-compute[73503]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d (non-flash)
Aug 26 13:22:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:22:01 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:22:01 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:22:01 user nova-compute[73503]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d (non-flash)
Aug 26 13:22:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30463c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[715aef1f-5f54-45df-83ad-7a46c47f10b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e39181-06a7-4cc4-a955-5b16c1545521]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64bda75-19a2-4d63-b60e-a408190f3c38]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7508c-2ff0-4a9f-8723-36486a2e6aa3]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc2ce97-7073-42ef-9536-21c55476a13f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8013052b-17d8-46d5-baa8-fb062ab8a8f2]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260]
Aug 26 13:22:01 user nova-compute[73503]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d, portal: 172.16.0.220,3260] successful.
Aug 26 13:22:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7eb2db81-3714-41f6-ba14-37a8a7fd035d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b0b159-c639-42e2-a232-b509af391dd9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] <== disconnect_volume: return (318ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:22:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:22:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:03 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'flavor' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5b148895-bcc0-4a8d-8f5b-d880bd1db155 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.053s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "interface-2a4aee9a-2301-4f73-a1fa-479dfc57893b-c848f28c-0fb9-417b-aee3-02d95a293561" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "interface-2a4aee9a-2301-4f73-a1fa-479dfc57893b-c848f28c-0fb9-417b-aee3-02d95a293561" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'flavor' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface> {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface> {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Attempting to detach device tapc848f28c-0f from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] detach device xml: <interface type="ethernet">
Aug 26 13:22:04 user nova-compute[73503]:   <mac address="fa:16:3e:af:1c:8f"/>
Aug 26 13:22:04 user nova-compute[73503]:   <model type="virtio"/>
Aug 26 13:22:04 user nova-compute[73503]:   <mtu size="1442"/>
Aug 26 13:22:04 user nova-compute[73503]:   <target dev="tapc848f28c-0f"/>
Aug 26 13:22:04 user nova-compute[73503]: </interface>
Aug 26 13:22:04 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface> {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 26 13:22:04 user nova-compute[73503]:   <name>instance-00000014</name>
Aug 26 13:22:04 user nova-compute[73503]:   <uuid>2a4aee9a-2301-4f73-a1fa-479dfc57893b</uuid>
Aug 26 13:22:04 user nova-compute[73503]:   <metadata>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:04 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:21:32</nova:creationTime>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:22:04 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:owner>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:owner>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:ports>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:22:04 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:04 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:port uuid="c848f28c-0fb9-417b-aee3-02d95a293561">
Aug 26 13:22:04 user nova-compute[73503]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Aug 26 13:22:04 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:ports>
Aug 26 13:22:04 user nova-compute[73503]: </nova:instance>
Aug 26 13:22:04 user nova-compute[73503]:   </metadata>
Aug 26 13:22:04 user nova-compute[73503]:   <memory unit='KiB'>524288</memory>
Aug 26 13:22:04 user nova-compute[73503]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 13:22:04 user nova-compute[73503]:   <vcpu placement='static'>1</vcpu>
Aug 26 13:22:04 user nova-compute[73503]:   <resource>
Aug 26 13:22:04 user nova-compute[73503]:     <partition>/machine</partition>
Aug 26 13:22:04 user nova-compute[73503]:   </resource>
Aug 26 13:22:04 user nova-compute[73503]:   <sysinfo type='smbios'>
Aug 26 13:22:04 user nova-compute[73503]:     <system>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='version'>0.0.0</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='serial'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='uuid'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='family'>Virtual Machine</entry>
Aug 26 13:22:04 user nova-compute[73503]:     </system>
Aug 26 13:22:04 user nova-compute[73503]:   </sysinfo>
Aug 26 13:22:04 user nova-compute[73503]:   <os>
Aug 26 13:22:04 user nova-compute[73503]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 13:22:04 user nova-compute[73503]:     <boot dev='hd'/>
Aug 26 13:22:04 user nova-compute[73503]:     <smbios mode='sysinfo'/>
Aug 26 13:22:04 user nova-compute[73503]:   </os>
Aug 26 13:22:04 user nova-compute[73503]:   <features>
Aug 26 13:22:04 user nova-compute[73503]:     <acpi/>
Aug 26 13:22:04 user nova-compute[73503]:     <apic/>
Aug 26 13:22:04 user nova-compute[73503]:     <vmcoreinfo state='on'/>
Aug 26 13:22:04 user nova-compute[73503]:   </features>
Aug 26 13:22:04 user nova-compute[73503]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 13:22:04 user nova-compute[73503]:     <model fallback='forbid'>Nehalem</model>
Aug 26 13:22:04 user nova-compute[73503]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 13:22:04 user nova-compute[73503]:     <feature policy='require' name='vme'/>
Aug 26 13:22:04 user nova-compute[73503]:     <feature policy='require' name='x2apic'/>
Aug 26 13:22:04 user nova-compute[73503]:     <feature policy='require' name='hypervisor'/>
Aug 26 13:22:04 user nova-compute[73503]:   </cpu>
Aug 26 13:22:04 user nova-compute[73503]:   <clock offset='utc'>
Aug 26 13:22:04 user nova-compute[73503]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 13:22:04 user nova-compute[73503]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 13:22:04 user nova-compute[73503]:     <timer name='hpet' present='no'/>
Aug 26 13:22:04 user nova-compute[73503]:   </clock>
Aug 26 13:22:04 user nova-compute[73503]:   <on_poweroff>destroy</on_poweroff>
Aug 26 13:22:04 user nova-compute[73503]:   <on_reboot>restart</on_reboot>
Aug 26 13:22:04 user nova-compute[73503]:   <on_crash>destroy</on_crash>
Aug 26 13:22:04 user nova-compute[73503]:   <devices>
Aug 26 13:22:04 user nova-compute[73503]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 13:22:04 user nova-compute[73503]:     <disk type='file' device='disk'>
Aug 26 13:22:04 user nova-compute[73503]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 13:22:04 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk' index='2'/>
Aug 26 13:22:04 user nova-compute[73503]:       <backingStore type='file' index='3'>
Aug 26 13:22:04 user nova-compute[73503]:         <format type='raw'/>
Aug 26 13:22:04 user nova-compute[73503]:         <source file='/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b'/>
Aug 26 13:22:04 user nova-compute[73503]:         <backingStore/>
Aug 26 13:22:04 user nova-compute[73503]:       </backingStore>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='vda' bus='virtio'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='virtio-disk0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </disk>
Aug 26 13:22:04 user nova-compute[73503]:     <disk type='file' device='cdrom'>
Aug 26 13:22:04 user nova-compute[73503]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 13:22:04 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config' index='1'/>
Aug 26 13:22:04 user nova-compute[73503]:       <backingStore/>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='hda' bus='ide'/>
Aug 26 13:22:04 user nova-compute[73503]:       <readonly/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='ide0-0-0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </disk>
Aug 26 13:22:04 user nova-compute[73503]:     <controller type='usb' index='0' model='none'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='usb'/>
Aug 26 13:22:04 user nova-compute[73503]:     </controller>
Aug 26 13:22:04 user nova-compute[73503]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='pci.0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </controller>
Aug 26 13:22:04 user nova-compute[73503]:     <controller type='ide' index='0'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='ide'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 13:22:04 user nova-compute[73503]:     </controller>
Aug 26 13:22:04 user nova-compute[73503]:     <interface type='ethernet'>
Aug 26 13:22:04 user nova-compute[73503]:       <mac address='fa:16:3e:0e:a6:5c'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='tap161e50eb-22'/>
Aug 26 13:22:04 user nova-compute[73503]:       <model type='virtio'/>
Aug 26 13:22:04 user nova-compute[73503]:       <mtu size='1442'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='net0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </interface>
Aug 26 13:22:04 user nova-compute[73503]:     <interface type='ethernet'>
Aug 26 13:22:04 user nova-compute[73503]:       <mac address='fa:16:3e:af:1c:8f'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='tapc848f28c-0f'/>
Aug 26 13:22:04 user nova-compute[73503]:       <model type='virtio'/>
Aug 26 13:22:04 user nova-compute[73503]:       <mtu size='1442'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='net1'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </interface>
Aug 26 13:22:04 user nova-compute[73503]:     <serial type='pty'>
Aug 26 13:22:04 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:04 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target type='isa-serial' port='0'>
Aug 26 13:22:04 user nova-compute[73503]:         <model name='isa-serial'/>
Aug 26 13:22:04 user nova-compute[73503]:       </target>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </serial>
Aug 26 13:22:04 user nova-compute[73503]:     <console type='pty' tty='/dev/pts/6'>
Aug 26 13:22:04 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:04 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target type='serial' port='0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </console>
Aug 26 13:22:04 user nova-compute[73503]:     <input type='mouse' bus='ps2'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='input0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </input>
Aug 26 13:22:04 user nova-compute[73503]:     <input type='keyboard' bus='ps2'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='input1'/>
Aug 26 13:22:04 user nova-compute[73503]:     </input>
Aug 26 13:22:04 user nova-compute[73503]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 26 13:22:04 user nova-compute[73503]:       <listen type='address' address='0.0.0.0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </graphics>
Aug 26 13:22:04 user nova-compute[73503]:     <audio id='1' type='none'/>
Aug 26 13:22:04 user nova-compute[73503]:     <video>
Aug 26 13:22:04 user nova-compute[73503]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='video0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </video>
Aug 26 13:22:04 user nova-compute[73503]:     <memballoon model='virtio'>
Aug 26 13:22:04 user nova-compute[73503]:       <stats period='10'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='balloon0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </memballoon>
Aug 26 13:22:04 user nova-compute[73503]:     <rng model='virtio'>
Aug 26 13:22:04 user nova-compute[73503]:       <backend model='random'>/dev/urandom</backend>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='rng0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </rng>
Aug 26 13:22:04 user nova-compute[73503]:   </devices>
Aug 26 13:22:04 user nova-compute[73503]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 13:22:04 user nova-compute[73503]:     <label>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</label>
Aug 26 13:22:04 user nova-compute[73503]:     <imagelabel>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</imagelabel>
Aug 26 13:22:04 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:04 user nova-compute[73503]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 13:22:04 user nova-compute[73503]:     <label>+64055:+108</label>
Aug 26 13:22:04 user nova-compute[73503]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 13:22:04 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:04 user nova-compute[73503]: </domain>
Aug 26 13:22:04 user nova-compute[73503]:  {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 13:22:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully detached device tapc848f28c-0f from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the persistent domain config.
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] (1/8): Attempting to detach device tapc848f28c-0f with device alias net1 from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] detach device xml: <interface type="ethernet">
Aug 26 13:22:04 user nova-compute[73503]:   <mac address="fa:16:3e:af:1c:8f"/>
Aug 26 13:22:04 user nova-compute[73503]:   <model type="virtio"/>
Aug 26 13:22:04 user nova-compute[73503]:   <mtu size="1442"/>
Aug 26 13:22:04 user nova-compute[73503]:   <target dev="tapc848f28c-0f"/>
Aug 26 13:22:04 user nova-compute[73503]: </interface>
Aug 26 13:22:04 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056124.5556157, 2a4aee9a-2301-4f73-a1fa-479dfc57893b => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Start waiting for the detach event from libvirt for device tapc848f28c-0f with device alias net1 for instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface> {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 26 13:22:04 user nova-compute[73503]:   <name>instance-00000014</name>
Aug 26 13:22:04 user nova-compute[73503]:   <uuid>2a4aee9a-2301-4f73-a1fa-479dfc57893b</uuid>
Aug 26 13:22:04 user nova-compute[73503]:   <metadata>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:04 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:21:32</nova:creationTime>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:22:04 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:owner>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:owner>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:ports>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:22:04 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:04 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:port uuid="c848f28c-0fb9-417b-aee3-02d95a293561">
Aug 26 13:22:04 user nova-compute[73503]:       <nova:ip type="fixed" address="10.10.10.160" ipVersion="4"/>
Aug 26 13:22:04 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:ports>
Aug 26 13:22:04 user nova-compute[73503]: </nova:instance>
Aug 26 13:22:04 user nova-compute[73503]:   </metadata>
Aug 26 13:22:04 user nova-compute[73503]:   <memory unit='KiB'>524288</memory>
Aug 26 13:22:04 user nova-compute[73503]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 13:22:04 user nova-compute[73503]:   <vcpu placement='static'>1</vcpu>
Aug 26 13:22:04 user nova-compute[73503]:   <resource>
Aug 26 13:22:04 user nova-compute[73503]:     <partition>/machine</partition>
Aug 26 13:22:04 user nova-compute[73503]:   </resource>
Aug 26 13:22:04 user nova-compute[73503]:   <sysinfo type='smbios'>
Aug 26 13:22:04 user nova-compute[73503]:     <system>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='version'>0.0.0</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='serial'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='uuid'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:04 user nova-compute[73503]:       <entry name='family'>Virtual Machine</entry>
Aug 26 13:22:04 user nova-compute[73503]:     </system>
Aug 26 13:22:04 user nova-compute[73503]:   </sysinfo>
Aug 26 13:22:04 user nova-compute[73503]:   <os>
Aug 26 13:22:04 user nova-compute[73503]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 13:22:04 user nova-compute[73503]:     <boot dev='hd'/>
Aug 26 13:22:04 user nova-compute[73503]:     <smbios mode='sysinfo'/>
Aug 26 13:22:04 user nova-compute[73503]:   </os>
Aug 26 13:22:04 user nova-compute[73503]:   <features>
Aug 26 13:22:04 user nova-compute[73503]:     <acpi/>
Aug 26 13:22:04 user nova-compute[73503]:     <apic/>
Aug 26 13:22:04 user nova-compute[73503]:     <vmcoreinfo state='on'/>
Aug 26 13:22:04 user nova-compute[73503]:   </features>
Aug 26 13:22:04 user nova-compute[73503]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 13:22:04 user nova-compute[73503]:     <model fallback='forbid'>Nehalem</model>
Aug 26 13:22:04 user nova-compute[73503]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 13:22:04 user nova-compute[73503]:     <feature policy='require' name='vme'/>
Aug 26 13:22:04 user nova-compute[73503]:     <feature policy='require' name='x2apic'/>
Aug 26 13:22:04 user nova-compute[73503]:     <feature policy='require' name='hypervisor'/>
Aug 26 13:22:04 user nova-compute[73503]:   </cpu>
Aug 26 13:22:04 user nova-compute[73503]:   <clock offset='utc'>
Aug 26 13:22:04 user nova-compute[73503]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 13:22:04 user nova-compute[73503]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 13:22:04 user nova-compute[73503]:     <timer name='hpet' present='no'/>
Aug 26 13:22:04 user nova-compute[73503]:   </clock>
Aug 26 13:22:04 user nova-compute[73503]:   <on_poweroff>destroy</on_poweroff>
Aug 26 13:22:04 user nova-compute[73503]:   <on_reboot>restart</on_reboot>
Aug 26 13:22:04 user nova-compute[73503]:   <on_crash>destroy</on_crash>
Aug 26 13:22:04 user nova-compute[73503]:   <devices>
Aug 26 13:22:04 user nova-compute[73503]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 13:22:04 user nova-compute[73503]:     <disk type='file' device='disk'>
Aug 26 13:22:04 user nova-compute[73503]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 13:22:04 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk' index='2'/>
Aug 26 13:22:04 user nova-compute[73503]:       <backingStore type='file' index='3'>
Aug 26 13:22:04 user nova-compute[73503]:         <format type='raw'/>
Aug 26 13:22:04 user nova-compute[73503]:         <source file='/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b'/>
Aug 26 13:22:04 user nova-compute[73503]:         <backingStore/>
Aug 26 13:22:04 user nova-compute[73503]:       </backingStore>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='vda' bus='virtio'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='virtio-disk0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </disk>
Aug 26 13:22:04 user nova-compute[73503]:     <disk type='file' device='cdrom'>
Aug 26 13:22:04 user nova-compute[73503]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 13:22:04 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config' index='1'/>
Aug 26 13:22:04 user nova-compute[73503]:       <backingStore/>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='hda' bus='ide'/>
Aug 26 13:22:04 user nova-compute[73503]:       <readonly/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='ide0-0-0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </disk>
Aug 26 13:22:04 user nova-compute[73503]:     <controller type='usb' index='0' model='none'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='usb'/>
Aug 26 13:22:04 user nova-compute[73503]:     </controller>
Aug 26 13:22:04 user nova-compute[73503]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='pci.0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </controller>
Aug 26 13:22:04 user nova-compute[73503]:     <controller type='ide' index='0'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='ide'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 13:22:04 user nova-compute[73503]:     </controller>
Aug 26 13:22:04 user nova-compute[73503]:     <interface type='ethernet'>
Aug 26 13:22:04 user nova-compute[73503]:       <mac address='fa:16:3e:0e:a6:5c'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target dev='tap161e50eb-22'/>
Aug 26 13:22:04 user nova-compute[73503]:       <model type='virtio'/>
Aug 26 13:22:04 user nova-compute[73503]:       <mtu size='1442'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='net0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </interface>
Aug 26 13:22:04 user nova-compute[73503]:     <serial type='pty'>
Aug 26 13:22:04 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:04 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target type='isa-serial' port='0'>
Aug 26 13:22:04 user nova-compute[73503]:         <model name='isa-serial'/>
Aug 26 13:22:04 user nova-compute[73503]:       </target>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </serial>
Aug 26 13:22:04 user nova-compute[73503]:     <console type='pty' tty='/dev/pts/6'>
Aug 26 13:22:04 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:04 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:04 user nova-compute[73503]:       <target type='serial' port='0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </console>
Aug 26 13:22:04 user nova-compute[73503]:     <input type='mouse' bus='ps2'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='input0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </input>
Aug 26 13:22:04 user nova-compute[73503]:     <input type='keyboard' bus='ps2'>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='input1'/>
Aug 26 13:22:04 user nova-compute[73503]:     </input>
Aug 26 13:22:04 user nova-compute[73503]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 26 13:22:04 user nova-compute[73503]:       <listen type='address' address='0.0.0.0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </graphics>
Aug 26 13:22:04 user nova-compute[73503]:     <audio id='1' type='none'/>
Aug 26 13:22:04 user nova-compute[73503]:     <video>
Aug 26 13:22:04 user nova-compute[73503]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='video0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </video>
Aug 26 13:22:04 user nova-compute[73503]:     <memballoon model='virtio'>
Aug 26 13:22:04 user nova-compute[73503]:       <stats period='10'/>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='balloon0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </memballoon>
Aug 26 13:22:04 user nova-compute[73503]:     <rng model='virtio'>
Aug 26 13:22:04 user nova-compute[73503]:       <backend model='random'>/dev/urandom</backend>
Aug 26 13:22:04 user nova-compute[73503]:       <alias name='rng0'/>
Aug 26 13:22:04 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 13:22:04 user nova-compute[73503]:     </rng>
Aug 26 13:22:04 user nova-compute[73503]:   </devices>
Aug 26 13:22:04 user nova-compute[73503]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 13:22:04 user nova-compute[73503]:     <label>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</label>
Aug 26 13:22:04 user nova-compute[73503]:     <imagelabel>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</imagelabel>
Aug 26 13:22:04 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:04 user nova-compute[73503]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 13:22:04 user nova-compute[73503]:     <label>+64055:+108</label>
Aug 26 13:22:04 user nova-compute[73503]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 13:22:04 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:04 user nova-compute[73503]: </domain>
Aug 26 13:22:04 user nova-compute[73503]:  {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 13:22:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully detached device tapc848f28c-0f from instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b from the live domain config.
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG os_vif [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc848f28c-0f, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:04 user nova-compute[73503]: INFO os_vif [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f')
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:04 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:22:04</nova:creationTime>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:22:04 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:owner>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:owner>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:04 user nova-compute[73503]:   <nova:ports>
Aug 26 13:22:04 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:22:04 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:04 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:04 user nova-compute[73503]:   </nova:ports>
Aug 26 13:22:04 user nova-compute[73503]: </nova:instance>
Aug 26 13:22:04 user nova-compute[73503]:  {{(pid=73503) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-822dd06a-af36-416b-8d16-fcb16a00704e req-de306dd6-03da-479a-a060-a51f34342182 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-unplugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-822dd06a-af36-416b-8d16-fcb16a00704e req-de306dd6-03da-479a-a060-a51f34342182 service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-822dd06a-af36-416b-8d16-fcb16a00704e req-de306dd6-03da-479a-a060-a51f34342182 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-822dd06a-af36-416b-8d16-fcb16a00704e req-de306dd6-03da-479a-a060-a51f34342182 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-822dd06a-af36-416b-8d16-fcb16a00704e req-de306dd6-03da-479a-a060-a51f34342182 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-unplugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:04 user nova-compute[73503]: WARNING nova.compute.manager [req-822dd06a-af36-416b-8d16-fcb16a00704e req-de306dd6-03da-479a-a060-a51f34342182 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-unplugged-c848f28c-0fb9-417b-aee3-02d95a293561 for instance with vm_state active and task_state None.
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-deleted-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:05 user nova-compute[73503]: INFO nova.compute.manager [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Neutron deleted interface c848f28c-0fb9-417b-aee3-02d95a293561; detaching it from the instance and deleting it from the info cache
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquired lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.objects.instance [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Lazy-loading 'system_metadata' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.objects.instance [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Lazy-loading 'flavor' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.objects.base [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Object Instance<2a4aee9a-2301-4f73-a1fa-479dfc57893b> lazy-loaded attributes: system_metadata,flavor {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Converting VIF {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface> {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 26 13:22:05 user nova-compute[73503]:   <name>instance-00000014</name>
Aug 26 13:22:05 user nova-compute[73503]:   <uuid>2a4aee9a-2301-4f73-a1fa-479dfc57893b</uuid>
Aug 26 13:22:05 user nova-compute[73503]:   <metadata>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:05 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:22:04</nova:creationTime>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:22:05 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:owner>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:owner>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:ports>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:22:05 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:05 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:ports>
Aug 26 13:22:05 user nova-compute[73503]: </nova:instance>
Aug 26 13:22:05 user nova-compute[73503]:   </metadata>
Aug 26 13:22:05 user nova-compute[73503]:   <memory unit='KiB'>524288</memory>
Aug 26 13:22:05 user nova-compute[73503]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 13:22:05 user nova-compute[73503]:   <vcpu placement='static'>1</vcpu>
Aug 26 13:22:05 user nova-compute[73503]:   <resource>
Aug 26 13:22:05 user nova-compute[73503]:     <partition>/machine</partition>
Aug 26 13:22:05 user nova-compute[73503]:   </resource>
Aug 26 13:22:05 user nova-compute[73503]:   <sysinfo type='smbios'>
Aug 26 13:22:05 user nova-compute[73503]:     <system>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='version'>0.0.0</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='serial'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='uuid'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='family'>Virtual Machine</entry>
Aug 26 13:22:05 user nova-compute[73503]:     </system>
Aug 26 13:22:05 user nova-compute[73503]:   </sysinfo>
Aug 26 13:22:05 user nova-compute[73503]:   <os>
Aug 26 13:22:05 user nova-compute[73503]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 13:22:05 user nova-compute[73503]:     <boot dev='hd'/>
Aug 26 13:22:05 user nova-compute[73503]:     <smbios mode='sysinfo'/>
Aug 26 13:22:05 user nova-compute[73503]:   </os>
Aug 26 13:22:05 user nova-compute[73503]:   <features>
Aug 26 13:22:05 user nova-compute[73503]:     <acpi/>
Aug 26 13:22:05 user nova-compute[73503]:     <apic/>
Aug 26 13:22:05 user nova-compute[73503]:     <vmcoreinfo state='on'/>
Aug 26 13:22:05 user nova-compute[73503]:   </features>
Aug 26 13:22:05 user nova-compute[73503]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 13:22:05 user nova-compute[73503]:     <model fallback='forbid'>Nehalem</model>
Aug 26 13:22:05 user nova-compute[73503]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 13:22:05 user nova-compute[73503]:     <feature policy='require' name='vme'/>
Aug 26 13:22:05 user nova-compute[73503]:     <feature policy='require' name='x2apic'/>
Aug 26 13:22:05 user nova-compute[73503]:     <feature policy='require' name='hypervisor'/>
Aug 26 13:22:05 user nova-compute[73503]:   </cpu>
Aug 26 13:22:05 user nova-compute[73503]:   <clock offset='utc'>
Aug 26 13:22:05 user nova-compute[73503]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 13:22:05 user nova-compute[73503]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 13:22:05 user nova-compute[73503]:     <timer name='hpet' present='no'/>
Aug 26 13:22:05 user nova-compute[73503]:   </clock>
Aug 26 13:22:05 user nova-compute[73503]:   <on_poweroff>destroy</on_poweroff>
Aug 26 13:22:05 user nova-compute[73503]:   <on_reboot>restart</on_reboot>
Aug 26 13:22:05 user nova-compute[73503]:   <on_crash>destroy</on_crash>
Aug 26 13:22:05 user nova-compute[73503]:   <devices>
Aug 26 13:22:05 user nova-compute[73503]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 13:22:05 user nova-compute[73503]:     <disk type='file' device='disk'>
Aug 26 13:22:05 user nova-compute[73503]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 13:22:05 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk' index='2'/>
Aug 26 13:22:05 user nova-compute[73503]:       <backingStore type='file' index='3'>
Aug 26 13:22:05 user nova-compute[73503]:         <format type='raw'/>
Aug 26 13:22:05 user nova-compute[73503]:         <source file='/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b'/>
Aug 26 13:22:05 user nova-compute[73503]:         <backingStore/>
Aug 26 13:22:05 user nova-compute[73503]:       </backingStore>
Aug 26 13:22:05 user nova-compute[73503]:       <target dev='vda' bus='virtio'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='virtio-disk0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </disk>
Aug 26 13:22:05 user nova-compute[73503]:     <disk type='file' device='cdrom'>
Aug 26 13:22:05 user nova-compute[73503]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 13:22:05 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config' index='1'/>
Aug 26 13:22:05 user nova-compute[73503]:       <backingStore/>
Aug 26 13:22:05 user nova-compute[73503]:       <target dev='hda' bus='ide'/>
Aug 26 13:22:05 user nova-compute[73503]:       <readonly/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='ide0-0-0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </disk>
Aug 26 13:22:05 user nova-compute[73503]:     <controller type='usb' index='0' model='none'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='usb'/>
Aug 26 13:22:05 user nova-compute[73503]:     </controller>
Aug 26 13:22:05 user nova-compute[73503]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='pci.0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </controller>
Aug 26 13:22:05 user nova-compute[73503]:     <controller type='ide' index='0'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='ide'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 13:22:05 user nova-compute[73503]:     </controller>
Aug 26 13:22:05 user nova-compute[73503]:     <interface type='ethernet'>
Aug 26 13:22:05 user nova-compute[73503]:       <mac address='fa:16:3e:0e:a6:5c'/>
Aug 26 13:22:05 user nova-compute[73503]:       <target dev='tap161e50eb-22'/>
Aug 26 13:22:05 user nova-compute[73503]:       <model type='virtio'/>
Aug 26 13:22:05 user nova-compute[73503]:       <mtu size='1442'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='net0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </interface>
Aug 26 13:22:05 user nova-compute[73503]:     <serial type='pty'>
Aug 26 13:22:05 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:05 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:05 user nova-compute[73503]:       <target type='isa-serial' port='0'>
Aug 26 13:22:05 user nova-compute[73503]:         <model name='isa-serial'/>
Aug 26 13:22:05 user nova-compute[73503]:       </target>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </serial>
Aug 26 13:22:05 user nova-compute[73503]:     <console type='pty' tty='/dev/pts/6'>
Aug 26 13:22:05 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:05 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:05 user nova-compute[73503]:       <target type='serial' port='0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </console>
Aug 26 13:22:05 user nova-compute[73503]:     <input type='mouse' bus='ps2'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='input0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </input>
Aug 26 13:22:05 user nova-compute[73503]:     <input type='keyboard' bus='ps2'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='input1'/>
Aug 26 13:22:05 user nova-compute[73503]:     </input>
Aug 26 13:22:05 user nova-compute[73503]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 26 13:22:05 user nova-compute[73503]:       <listen type='address' address='0.0.0.0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </graphics>
Aug 26 13:22:05 user nova-compute[73503]:     <audio id='1' type='none'/>
Aug 26 13:22:05 user nova-compute[73503]:     <video>
Aug 26 13:22:05 user nova-compute[73503]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='video0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </video>
Aug 26 13:22:05 user nova-compute[73503]:     <memballoon model='virtio'>
Aug 26 13:22:05 user nova-compute[73503]:       <stats period='10'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='balloon0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </memballoon>
Aug 26 13:22:05 user nova-compute[73503]:     <rng model='virtio'>
Aug 26 13:22:05 user nova-compute[73503]:       <backend model='random'>/dev/urandom</backend>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='rng0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </rng>
Aug 26 13:22:05 user nova-compute[73503]:   </devices>
Aug 26 13:22:05 user nova-compute[73503]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 13:22:05 user nova-compute[73503]:     <label>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</label>
Aug 26 13:22:05 user nova-compute[73503]:     <imagelabel>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</imagelabel>
Aug 26 13:22:05 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:05 user nova-compute[73503]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 13:22:05 user nova-compute[73503]:     <label>+64055:+108</label>
Aug 26 13:22:05 user nova-compute[73503]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 13:22:05 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:05 user nova-compute[73503]: </domain>
Aug 26 13:22:05 user nova-compute[73503]:  {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface> {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:af:1c:8f"/><model type="virtio"/><mtu size="1442"/><target dev="tapc848f28c-0f"/></interface>not found in domain: <domain type='kvm' id='27'>
Aug 26 13:22:05 user nova-compute[73503]:   <name>instance-00000014</name>
Aug 26 13:22:05 user nova-compute[73503]:   <uuid>2a4aee9a-2301-4f73-a1fa-479dfc57893b</uuid>
Aug 26 13:22:05 user nova-compute[73503]:   <metadata>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:05 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:22:04</nova:creationTime>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:22:05 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:owner>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:owner>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:ports>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:22:05 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:05 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:ports>
Aug 26 13:22:05 user nova-compute[73503]: </nova:instance>
Aug 26 13:22:05 user nova-compute[73503]:   </metadata>
Aug 26 13:22:05 user nova-compute[73503]:   <memory unit='KiB'>524288</memory>
Aug 26 13:22:05 user nova-compute[73503]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 13:22:05 user nova-compute[73503]:   <vcpu placement='static'>1</vcpu>
Aug 26 13:22:05 user nova-compute[73503]:   <resource>
Aug 26 13:22:05 user nova-compute[73503]:     <partition>/machine</partition>
Aug 26 13:22:05 user nova-compute[73503]:   </resource>
Aug 26 13:22:05 user nova-compute[73503]:   <sysinfo type='smbios'>
Aug 26 13:22:05 user nova-compute[73503]:     <system>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='version'>0.0.0</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='serial'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='uuid'>2a4aee9a-2301-4f73-a1fa-479dfc57893b</entry>
Aug 26 13:22:05 user nova-compute[73503]:       <entry name='family'>Virtual Machine</entry>
Aug 26 13:22:05 user nova-compute[73503]:     </system>
Aug 26 13:22:05 user nova-compute[73503]:   </sysinfo>
Aug 26 13:22:05 user nova-compute[73503]:   <os>
Aug 26 13:22:05 user nova-compute[73503]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 13:22:05 user nova-compute[73503]:     <boot dev='hd'/>
Aug 26 13:22:05 user nova-compute[73503]:     <smbios mode='sysinfo'/>
Aug 26 13:22:05 user nova-compute[73503]:   </os>
Aug 26 13:22:05 user nova-compute[73503]:   <features>
Aug 26 13:22:05 user nova-compute[73503]:     <acpi/>
Aug 26 13:22:05 user nova-compute[73503]:     <apic/>
Aug 26 13:22:05 user nova-compute[73503]:     <vmcoreinfo state='on'/>
Aug 26 13:22:05 user nova-compute[73503]:   </features>
Aug 26 13:22:05 user nova-compute[73503]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 13:22:05 user nova-compute[73503]:     <model fallback='forbid'>Nehalem</model>
Aug 26 13:22:05 user nova-compute[73503]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 13:22:05 user nova-compute[73503]:     <feature policy='require' name='vme'/>
Aug 26 13:22:05 user nova-compute[73503]:     <feature policy='require' name='x2apic'/>
Aug 26 13:22:05 user nova-compute[73503]:     <feature policy='require' name='hypervisor'/>
Aug 26 13:22:05 user nova-compute[73503]:   </cpu>
Aug 26 13:22:05 user nova-compute[73503]:   <clock offset='utc'>
Aug 26 13:22:05 user nova-compute[73503]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 13:22:05 user nova-compute[73503]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 13:22:05 user nova-compute[73503]:     <timer name='hpet' present='no'/>
Aug 26 13:22:05 user nova-compute[73503]:   </clock>
Aug 26 13:22:05 user nova-compute[73503]:   <on_poweroff>destroy</on_poweroff>
Aug 26 13:22:05 user nova-compute[73503]:   <on_reboot>restart</on_reboot>
Aug 26 13:22:05 user nova-compute[73503]:   <on_crash>destroy</on_crash>
Aug 26 13:22:05 user nova-compute[73503]:   <devices>
Aug 26 13:22:05 user nova-compute[73503]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 13:22:05 user nova-compute[73503]:     <disk type='file' device='disk'>
Aug 26 13:22:05 user nova-compute[73503]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 13:22:05 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk' index='2'/>
Aug 26 13:22:05 user nova-compute[73503]:       <backingStore type='file' index='3'>
Aug 26 13:22:05 user nova-compute[73503]:         <format type='raw'/>
Aug 26 13:22:05 user nova-compute[73503]:         <source file='/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b'/>
Aug 26 13:22:05 user nova-compute[73503]:         <backingStore/>
Aug 26 13:22:05 user nova-compute[73503]:       </backingStore>
Aug 26 13:22:05 user nova-compute[73503]:       <target dev='vda' bus='virtio'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='virtio-disk0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </disk>
Aug 26 13:22:05 user nova-compute[73503]:     <disk type='file' device='cdrom'>
Aug 26 13:22:05 user nova-compute[73503]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 13:22:05 user nova-compute[73503]:       <source file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk.config' index='1'/>
Aug 26 13:22:05 user nova-compute[73503]:       <backingStore/>
Aug 26 13:22:05 user nova-compute[73503]:       <target dev='hda' bus='ide'/>
Aug 26 13:22:05 user nova-compute[73503]:       <readonly/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='ide0-0-0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </disk>
Aug 26 13:22:05 user nova-compute[73503]:     <controller type='usb' index='0' model='none'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='usb'/>
Aug 26 13:22:05 user nova-compute[73503]:     </controller>
Aug 26 13:22:05 user nova-compute[73503]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='pci.0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </controller>
Aug 26 13:22:05 user nova-compute[73503]:     <controller type='ide' index='0'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='ide'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 13:22:05 user nova-compute[73503]:     </controller>
Aug 26 13:22:05 user nova-compute[73503]:     <interface type='ethernet'>
Aug 26 13:22:05 user nova-compute[73503]:       <mac address='fa:16:3e:0e:a6:5c'/>
Aug 26 13:22:05 user nova-compute[73503]:       <target dev='tap161e50eb-22'/>
Aug 26 13:22:05 user nova-compute[73503]:       <model type='virtio'/>
Aug 26 13:22:05 user nova-compute[73503]:       <mtu size='1442'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='net0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </interface>
Aug 26 13:22:05 user nova-compute[73503]:     <serial type='pty'>
Aug 26 13:22:05 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:05 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:05 user nova-compute[73503]:       <target type='isa-serial' port='0'>
Aug 26 13:22:05 user nova-compute[73503]:         <model name='isa-serial'/>
Aug 26 13:22:05 user nova-compute[73503]:       </target>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </serial>
Aug 26 13:22:05 user nova-compute[73503]:     <console type='pty' tty='/dev/pts/6'>
Aug 26 13:22:05 user nova-compute[73503]:       <source path='/dev/pts/6'/>
Aug 26 13:22:05 user nova-compute[73503]:       <log file='/opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/console.log' append='off'/>
Aug 26 13:22:05 user nova-compute[73503]:       <target type='serial' port='0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='serial0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </console>
Aug 26 13:22:05 user nova-compute[73503]:     <input type='mouse' bus='ps2'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='input0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </input>
Aug 26 13:22:05 user nova-compute[73503]:     <input type='keyboard' bus='ps2'>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='input1'/>
Aug 26 13:22:05 user nova-compute[73503]:     </input>
Aug 26 13:22:05 user nova-compute[73503]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 26 13:22:05 user nova-compute[73503]:       <listen type='address' address='0.0.0.0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </graphics>
Aug 26 13:22:05 user nova-compute[73503]:     <audio id='1' type='none'/>
Aug 26 13:22:05 user nova-compute[73503]:     <video>
Aug 26 13:22:05 user nova-compute[73503]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='video0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </video>
Aug 26 13:22:05 user nova-compute[73503]:     <memballoon model='virtio'>
Aug 26 13:22:05 user nova-compute[73503]:       <stats period='10'/>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='balloon0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </memballoon>
Aug 26 13:22:05 user nova-compute[73503]:     <rng model='virtio'>
Aug 26 13:22:05 user nova-compute[73503]:       <backend model='random'>/dev/urandom</backend>
Aug 26 13:22:05 user nova-compute[73503]:       <alias name='rng0'/>
Aug 26 13:22:05 user nova-compute[73503]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 13:22:05 user nova-compute[73503]:     </rng>
Aug 26 13:22:05 user nova-compute[73503]:   </devices>
Aug 26 13:22:05 user nova-compute[73503]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 13:22:05 user nova-compute[73503]:     <label>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</label>
Aug 26 13:22:05 user nova-compute[73503]:     <imagelabel>libvirt-2a4aee9a-2301-4f73-a1fa-479dfc57893b</imagelabel>
Aug 26 13:22:05 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:05 user nova-compute[73503]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 13:22:05 user nova-compute[73503]:     <label>+64055:+108</label>
Aug 26 13:22:05 user nova-compute[73503]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 13:22:05 user nova-compute[73503]:   </seclabel>
Aug 26 13:22:05 user nova-compute[73503]: </domain>
Aug 26 13:22:05 user nova-compute[73503]:  {{(pid=73503) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 13:22:05 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Detaching interface fa:16:3e:af:1c:8f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapc848f28c-0f' not found.
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Converting VIF {"id": "c848f28c-0fb9-417b-aee3-02d95a293561", "address": "fa:16:3e:af:1c:8f", "network": {"id": "5b28b442-bde3-489a-a6f9-1415a034876d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1379803471", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc848f28c-0f", "ovs_interfaceid": "c848f28c-0fb9-417b-aee3-02d95a293561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG os_vif [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc848f28c-0f, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:22:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:22:05 user nova-compute[73503]: INFO os_vif [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:1c:8f,bridge_name='br-int',has_traffic_filtering=True,id=c848f28c-0fb9-417b-aee3-02d95a293561,network=Network(5b28b442-bde3-489a-a6f9-1415a034876d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc848f28c-0f')
Aug 26 13:22:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [req-6a15a0e0-8a4c-4b3f-b625-6a747f1a9f9d req-1d9e555c-b9a0-45c2-ae30-7352ef2a0c22 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:05 user nova-compute[73503]:   <nova:package version="0.0.0"/>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:name>tempest-device-tagging-server-127017182</nova:name>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:creationTime>2023-08-26 13:22:05</nova:creationTime>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:flavor name="m1.tiny">
Aug 26 13:22:05 user nova-compute[73503]:     <nova:memory>512</nova:memory>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:disk>1</nova:disk>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:swap>0</nova:swap>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:flavor>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:owner>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:user uuid="7fd620945d8b4acabdf767d34fe696f0">tempest-TaggedAttachmentsTest-1169990808-project-member</nova:user>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:project uuid="e8b69eae5d6f48968913dc31408311bb">tempest-TaggedAttachmentsTest-1169990808</nova:project>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:owner>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:05 user nova-compute[73503]:   <nova:ports>
Aug 26 13:22:05 user nova-compute[73503]:     <nova:port uuid="161e50eb-2232-4f63-bb55-c642cb4db883">
Aug 26 13:22:05 user nova-compute[73503]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:05 user nova-compute[73503]:     </nova:port>
Aug 26 13:22:05 user nova-compute[73503]:   </nova:ports>
Aug 26 13:22:05 user nova-compute[73503]: </nova:instance>
Aug 26 13:22:05 user nova-compute[73503]:  {{(pid=73503) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 13:22:06 user nova-compute[73503]: DEBUG nova.network.neutron [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [{"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Releasing lock "refresh_cache-2a4aee9a-2301-4f73-a1fa-479dfc57893b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:22:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ad2cfb91-5379-4b60-b03e-c8c5607e2667 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "interface-2a4aee9a-2301-4f73-a1fa-479dfc57893b-c848f28c-0fb9-417b-aee3-02d95a293561" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.263s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-960a9ded-de97-41cd-b451-f0f91b465270 req-0bbdc929-4440-4e21-8c34-27ce08feafcc service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-960a9ded-de97-41cd-b451-f0f91b465270 req-0bbdc929-4440-4e21-8c34-27ce08feafcc service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-960a9ded-de97-41cd-b451-f0f91b465270 req-0bbdc929-4440-4e21-8c34-27ce08feafcc service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-960a9ded-de97-41cd-b451-f0f91b465270 req-0bbdc929-4440-4e21-8c34-27ce08feafcc service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-960a9ded-de97-41cd-b451-f0f91b465270 req-0bbdc929-4440-4e21-8c34-27ce08feafcc service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:07 user nova-compute[73503]: WARNING nova.compute.manager [req-960a9ded-de97-41cd-b451-f0f91b465270 req-0bbdc929-4440-4e21-8c34-27ce08feafcc service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-plugged-c848f28c-0fb9-417b-aee3-02d95a293561 for instance with vm_state active and task_state None.
Aug 26 13:22:07 user nova-compute[73503]: INFO nova.compute.manager [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] instance snapshotting
Aug 26 13:22:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Beginning live snapshot process
Aug 26 13:22:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json -f qcow2" returned: 0 in 0.263s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpchbyy6fj/8f035f2d33ad403bb0fc5f294ab2e73e.delta 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpchbyy6fj/8f035f2d33ad403bb0fc5f294ab2e73e.delta 1073741824" returned: 0 in 0.051s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 13:22:08 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:22:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:22:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 13:22:10 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:22:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpchbyy6fj/8f035f2d33ad403bb0fc5f294ab2e73e.delta /opt/stack/data/nova/instances/snapshots/tmpchbyy6fj/8f035f2d33ad403bb0fc5f294ab2e73e {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpchbyy6fj/8f035f2d33ad403bb0fc5f294ab2e73e.delta /opt/stack/data/nova/instances/snapshots/tmpchbyy6fj/8f035f2d33ad403bb0fc5f294ab2e73e" returned: 0 in 0.634s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:10 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Snapshot extracted, beginning image upload
Aug 26 13:22:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:22:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:22:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Snapshot image upload complete
Aug 26 13:22:13 user nova-compute[73503]: INFO nova.compute.manager [None req-71cf1456-a050-420f-9833-33a21ea0e1a5 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Took 5.63 seconds to snapshot the instance on the hypervisor.
Aug 26 13:22:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:22:15 user nova-compute[73503]: INFO nova.compute.claims [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Claim successful on node user
Aug 26 13:22:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:22:15 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.575s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:22:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.policy [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8afe79d50d64cc3b087d5ecaacc66cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af4179d75d5a49ffa8caae46f900f993', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:22:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Creating image(s)
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "/opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "/opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "87e9f2792953c84d290f08ea578c81d5724b422f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "87e9f2792953c84d290f08ea578c81d5724b422f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG nova.network.neutron [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Successfully created port: 7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.982s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.part --force-share --output=json" returned: 0 in 0.213s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG nova.virt.images [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] a3dfe2a6-48db-4e42-afdd-013b1feade2f was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.part /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.part /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.converted" returned: 0 in 0.292s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "87e9f2792953c84d290f08ea578c81d5724b422f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.592s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Successfully updated port: 7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.compute.manager [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-changed-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.compute.manager [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Refreshing instance network info cache due to event network-changed-7e469415-9c9e-4677-9fc2-aef5ee3b0aed. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] Acquiring lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] Acquired lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.network.neutron [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Refreshing network info cache for port 7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "87e9f2792953c84d290f08ea578c81d5724b422f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "87e9f2792953c84d290f08ea578c81d5724b422f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.network.neutron [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f,backing_fmt=raw /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f,backing_fmt=raw /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk 1073741824" returned: 0 in 0.048s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "87e9f2792953c84d290f08ea578c81d5724b422f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.network.neutron [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cd627471-2265-4878-ad19-3550202b6fb9 req-19c8ee1c-4149-4bf1-8b24-9284f2d566e0 service nova] Releasing lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquired lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Ensure instance console log exists: /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updating instance_info_cache with network_info: [{"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Releasing lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Instance network_info: |[{"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Start _get_guest_xml network_info=[{"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7b2a099f571e48465ac11d85b0f3c83f',container_format='bare',created_at=2023-08-26T13:22:07Z,direct_url=<?>,disk_format='qcow2',id=a3dfe2a6-48db-4e42-afdd-013b1feade2f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1038236784',owner='af4179d75d5a49ffa8caae46f900f993',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T13:22:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': 'a3dfe2a6-48db-4e42-afdd-013b1feade2f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:22:19 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:22:19 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7b2a099f571e48465ac11d85b0f3c83f',container_format='bare',created_at=2023-08-26T13:22:07Z,direct_url=<?>,disk_format='qcow2',id=a3dfe2a6-48db-4e42-afdd-013b1feade2f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1038236784',owner='af4179d75d5a49ffa8caae46f900f993',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T13:22:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1117575148',display_name='tempest-TestStampPattern-server-1117575148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1117575148',id=25,image_ref='a3dfe2a6-48db-4e42-afdd-013b1feade2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn2+pFLZ2VSZx7AckabSo562zlp19RUMBiOGyV73023vTl3GUKSePV72rfCWrRK/uBW0wHSSndFaIZ2aHgqtusbD669E0l1ESLIroNlZsjUuKyclKN2VYcnFWYA9yluhg==',key_name='tempest-TestStampPattern-764130994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4179d75d5a49ffa8caae46f900f993',ramdisk_id='',reservation_id='r-trcrfjm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6fb3f5db-a603-4982-8304-c4601a5c5b17',image_min_disk='1',image_min_ram='0',image_owner_id='af4179d75d5a49ffa8caae46f900f993',image_owner_project_name='tempest-TestStampPattern-585487806',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-585487806-project-member',image_user_id='a8afe79d50d64cc3b087d5ecaacc66cb',network_allocated='True',owner_project_name='tempest-TestStampPattern-585487806',owner_user_name='tempest-TestStampPattern-585487806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:22:16Z,user_data=None,user_id='a8afe79d50d64cc3b087d5ecaacc66cb',uuid=c7eb91d5-a544-464f-9bd5-26f579f05222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converting VIF {"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.objects.instance [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'pci_devices' on Instance uuid c7eb91d5-a544-464f-9bd5-26f579f05222 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:22:19 user nova-compute[73503]:   <uuid>c7eb91d5-a544-464f-9bd5-26f579f05222</uuid>
Aug 26 13:22:19 user nova-compute[73503]:   <name>instance-00000019</name>
Aug 26 13:22:19 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:22:19 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:22:19 user nova-compute[73503]:   <metadata>
Aug 26 13:22:19 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:19 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:22:19 user nova-compute[73503]:       <nova:name>tempest-TestStampPattern-server-1117575148</nova:name>
Aug 26 13:22:19 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:22:19</nova:creationTime>
Aug 26 13:22:19 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:22:19 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:19 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:22:19 user nova-compute[73503]:       <nova:owner>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:user uuid="a8afe79d50d64cc3b087d5ecaacc66cb">tempest-TestStampPattern-585487806-project-member</nova:user>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:project uuid="af4179d75d5a49ffa8caae46f900f993">tempest-TestStampPattern-585487806</nova:project>
Aug 26 13:22:19 user nova-compute[73503]:       </nova:owner>
Aug 26 13:22:19 user nova-compute[73503]:       <nova:root type="image" uuid="a3dfe2a6-48db-4e42-afdd-013b1feade2f"/>
Aug 26 13:22:19 user nova-compute[73503]:       <nova:ports>
Aug 26 13:22:19 user nova-compute[73503]:         <nova:port uuid="7e469415-9c9e-4677-9fc2-aef5ee3b0aed">
Aug 26 13:22:19 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:22:19 user nova-compute[73503]:         </nova:port>
Aug 26 13:22:19 user nova-compute[73503]:       </nova:ports>
Aug 26 13:22:19 user nova-compute[73503]:     </nova:instance>
Aug 26 13:22:19 user nova-compute[73503]:   </metadata>
Aug 26 13:22:19 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:22:19 user nova-compute[73503]:     <system>
Aug 26 13:22:19 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:22:19 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:22:19 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:22:19 user nova-compute[73503]:       <entry name="serial">c7eb91d5-a544-464f-9bd5-26f579f05222</entry>
Aug 26 13:22:19 user nova-compute[73503]:       <entry name="uuid">c7eb91d5-a544-464f-9bd5-26f579f05222</entry>
Aug 26 13:22:19 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:22:19 user nova-compute[73503]:     </system>
Aug 26 13:22:19 user nova-compute[73503]:   </sysinfo>
Aug 26 13:22:19 user nova-compute[73503]:   <os>
Aug 26 13:22:19 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:22:19 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:22:19 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:22:19 user nova-compute[73503]:   </os>
Aug 26 13:22:19 user nova-compute[73503]:   <features>
Aug 26 13:22:19 user nova-compute[73503]:     <acpi/>
Aug 26 13:22:19 user nova-compute[73503]:     <apic/>
Aug 26 13:22:19 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:22:19 user nova-compute[73503]:   </features>
Aug 26 13:22:19 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:22:19 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:22:19 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:22:19 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:22:19 user nova-compute[73503]:   </clock>
Aug 26 13:22:19 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:22:19 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:22:19 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:22:19 user nova-compute[73503]:   </cpu>
Aug 26 13:22:19 user nova-compute[73503]:   <devices>
Aug 26 13:22:19 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:22:19 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:22:19 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk"/>
Aug 26 13:22:19 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:22:19 user nova-compute[73503]:     </disk>
Aug 26 13:22:19 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:22:19 user nova-compute[73503]:       <mac address="fa:16:3e:94:90:9c"/>
Aug 26 13:22:19 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:22:19 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:22:19 user nova-compute[73503]:       <target dev="tap7e469415-9c"/>
Aug 26 13:22:19 user nova-compute[73503]:     </interface>
Aug 26 13:22:19 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:22:19 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/console.log" append="off"/>
Aug 26 13:22:19 user nova-compute[73503]:     </serial>
Aug 26 13:22:19 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:22:19 user nova-compute[73503]:     <video>
Aug 26 13:22:19 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:22:19 user nova-compute[73503]:     </video>
Aug 26 13:22:19 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:22:19 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:22:19 user nova-compute[73503]:     </rng>
Aug 26 13:22:19 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:22:19 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:22:19 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:22:19 user nova-compute[73503]:     </memballoon>
Aug 26 13:22:19 user nova-compute[73503]:   </devices>
Aug 26 13:22:19 user nova-compute[73503]: </domain>
Aug 26 13:22:19 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1117575148',display_name='tempest-TestStampPattern-server-1117575148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1117575148',id=25,image_ref='a3dfe2a6-48db-4e42-afdd-013b1feade2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn2+pFLZ2VSZx7AckabSo562zlp19RUMBiOGyV73023vTl3GUKSePV72rfCWrRK/uBW0wHSSndFaIZ2aHgqtusbD669E0l1ESLIroNlZsjUuKyclKN2VYcnFWYA9yluhg==',key_name='tempest-TestStampPattern-764130994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af4179d75d5a49ffa8caae46f900f993',ramdisk_id='',reservation_id='r-trcrfjm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6fb3f5db-a603-4982-8304-c4601a5c5b17',image_min_disk='1',image_min_ram='0',image_owner_id='af4179d75d5a49ffa8caae46f900f993',image_owner_project_name='tempest-TestStampPattern-585487806',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-585487806-project-member',image_user_id='a8afe79d50d64cc3b087d5ecaacc66cb',network_allocated='True',owner_project_name='tempest-TestStampPattern-585487806',owner_user_name='tempest-TestStampPattern-585487806-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:22:16Z,user_data=None,user_id='a8afe79d50d64cc3b087d5ecaacc66cb',uuid=c7eb91d5-a544-464f-9bd5-26f579f05222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converting VIF {"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG os_vif [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e469415-9c, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e469415-9c, col_values=(('external_ids', {'iface-id': '7e469415-9c9e-4677-9fc2-aef5ee3b0aed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:90:9c', 'vm-uuid': 'c7eb91d5-a544-464f-9bd5-26f579f05222'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:19 user nova-compute[73503]: INFO os_vif [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c')
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No VIF found with MAC fa:16:3e:94:90:9c, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-3532b390-c0bc-447a-9a93-b02fddbbf8e3 req-cbd16d39-20f5-4980-9c34-f3cea02eddb3 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3532b390-c0bc-447a-9a93-b02fddbbf8e3 req-cbd16d39-20f5-4980-9c34-f3cea02eddb3 service nova] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3532b390-c0bc-447a-9a93-b02fddbbf8e3 req-cbd16d39-20f5-4980-9c34-f3cea02eddb3 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3532b390-c0bc-447a-9a93-b02fddbbf8e3 req-cbd16d39-20f5-4980-9c34-f3cea02eddb3 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-3532b390-c0bc-447a-9a93-b02fddbbf8e3 req-cbd16d39-20f5-4980-9c34-f3cea02eddb3 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] No waiting events found dispatching network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:21 user nova-compute[73503]: WARNING nova.compute.manager [req-3532b390-c0bc-447a-9a93-b02fddbbf8e3 req-cbd16d39-20f5-4980-9c34-f3cea02eddb3 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received unexpected event network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed for instance with vm_state building and task_state spawning.
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:22:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7187MB free_disk=25.13607406616211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance de9a2cdb-bee4-4901-8dac-34ca47682cdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 90c4814c-43f2-454f-964b-6179892193c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c7eb91d5-a544-464f-9bd5-26f579f05222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:22:22 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.786s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-2c8b4866-1421-4225-ab9c-f580ca9b1119 req-5de49a35-40cd-4d1a-89cf-5c8b652123e3 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2c8b4866-1421-4225-ab9c-f580ca9b1119 req-5de49a35-40cd-4d1a-89cf-5c8b652123e3 service nova] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2c8b4866-1421-4225-ab9c-f580ca9b1119 req-5de49a35-40cd-4d1a-89cf-5c8b652123e3 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2c8b4866-1421-4225-ab9c-f580ca9b1119 req-5de49a35-40cd-4d1a-89cf-5c8b652123e3 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-2c8b4866-1421-4225-ab9c-f580ca9b1119 req-5de49a35-40cd-4d1a-89cf-5c8b652123e3 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] No waiting events found dispatching network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:23 user nova-compute[73503]: WARNING nova.compute.manager [req-2c8b4866-1421-4225-ab9c-f580ca9b1119 req-5de49a35-40cd-4d1a-89cf-5c8b652123e3 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received unexpected event network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed for instance with vm_state building and task_state spawning.
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056143.4265952, c7eb91d5-a544-464f-9bd5-26f579f05222 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] VM Resumed (Lifecycle Event)
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Instance spawned successfully.
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056143.42672, c7eb91d5-a544-464f-9bd5-26f579f05222 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] VM Started (Lifecycle Event)
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Rescuing
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 26 13:22:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:23 user nova-compute[73503]: INFO nova.compute.manager [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Took 8.27 seconds to build instance.
Aug 26 13:22:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-81b094b1-b9d3-4dc7-ad25-489803eadeff tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.372s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance destroyed successfully.
Aug 26 13:22:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Attempting a stable device rescue
Aug 26 13:22:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [{"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-de9a2cdb-bee4-4901-8dac-34ca47682cdf" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73503) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:22:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Creating image(s)
Aug 26 13:22:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "/opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "f489c11b2cf5a673ccd39e17715ff94979462337" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "f489c11b2cf5a673ccd39e17715ff94979462337" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:26 user nova-compute[73503]: WARNING nova.compute.manager [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state active and task_state rescuing.
Aug 26 13:22:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:26 user nova-compute[73503]: WARNING nova.compute.manager [req-dc6e7559-c130-4a47-a3f6-dfeea9c58853 req-b030f102-40bc-4abe-a0d3-17a21901e4fa service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state active and task_state rescuing.
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.part --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG nova.virt.images [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] 5326b254-5fd6-4a84-91c3-27f7e28139aa was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.part /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.part /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.converted" returned: 0 in 0.536s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "f489c11b2cf5a673ccd39e17715ff94979462337" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.114s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "f489c11b2cf5a673ccd39e17715ff94979462337" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "f489c11b2cf5a673ccd39e17715ff94979462337" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337 --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337,backing_fmt=raw /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337,backing_fmt=raw /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue" returned: 0 in 0.054s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "f489c11b2cf5a673ccd39e17715ff94979462337" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'migration_context' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<6472acd9-81af-48fe-9650-0cfb8146dbd0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Start _get_guest_xml network_info=[{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "vif_mac": "fa:16:3e:85:0c:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5326b254-5fd6-4a84-91c3-27f7e28139aa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6472acd9-81af-48fe-9650-0cfb8146dbd0', 'attached_at': '', 'detached_at': '', 'volume_id': '4f637674-bc8a-4cf9-9047-5af7b3e4b6be', 'serial': '4f637674-bc8a-4cf9-9047-5af7b3e4b6be'}, 'attachment_id': '22d4a4ae-a2fc-4a91-b511-8ce61594eac6', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'resources' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<6472acd9-81af-48fe-9650-0cfb8146dbd0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'numa_topology' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<6472acd9-81af-48fe-9650-0cfb8146dbd0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:22:27 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:22:27 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<6472acd9-81af-48fe-9650-0cfb8146dbd0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:22:27 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:22:27 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:22:27 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295f70a-78ba-4b63-a059-ca7303fa12d5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qiKESuzs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 13:22:27 user nova-compute[73503]: node.name = iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be
Aug 26 13:22:27 user nova-compute[73503]: node.tpgt = -1
Aug 26 13:22:27 user nova-compute[73503]: node.startup = automatic
Aug 26 13:22:27 user nova-compute[73503]: node.leading_login = No
Aug 26 13:22:27 user nova-compute[73503]: iface.iscsi_ifacename = default
Aug 26 13:22:27 user nova-compute[73503]: iface.net_ifacename = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.ipaddress = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.prefix_len = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.hwaddress = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.transport_name = tcp
Aug 26 13:22:27 user nova-compute[73503]: iface.initiatorname = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.vlan_id = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.vlan_priority = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.vlan_state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.iface_num = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.mtu = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.port = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.bootproto = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.subnet_mask = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.gateway = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_alt_client_id = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_dns = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_learn_iqn = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_vendor_id_state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_vendor_id = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.dhcp_slp_da = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.fragmentation = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.gratuitous_arp = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.incoming_forwarding = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.tos_state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.tos = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.ttl = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.delayed_ack = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.tcp_nagle = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.tcp_wsf_state = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.tcp_wsf = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.tcp_timer_scale = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.tcp_timestamp = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.redirect = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.def_task_mgmt_timeout = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.header_digest = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.data_digest = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.immediate_data = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.initial_r2t = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.data_seq_inorder = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.data_pdu_inorder = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.erl = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.max_receive_data_len = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.first_burst_len = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.max_outstanding_r2t = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.max_burst_len = 0
Aug 26 13:22:27 user nova-compute[73503]: iface.chap_auth = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.bidi_chap = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.strict_login_compliance = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.discovery_auth = <empty>
Aug 26 13:22:27 user nova-compute[73503]: iface.discovery_logout = <empty>
Aug 26 13:22:27 user nova-compute[73503]: node.discovery_address = <empty>
Aug 26 13:22:27 user nova-compute[73503]: node.discovery_port = 0
Aug 26 13:22:27 user nova-compute[73503]: node.discovery_type = static
Aug 26 13:22:27 user nova-compute[73503]: node.session.initial_cmdsn = 0
Aug 26 13:22:27 user nova-compute[73503]: node.session.initial_login_retry_max = 8
Aug 26 13:22:27 user nova-compute[73503]: node.session.xmit_thread_priority = -20
Aug 26 13:22:27 user nova-compute[73503]: node.session.cmds_max = 128
Aug 26 13:22:27 user nova-compute[73503]: node.session.queue_depth = 32
Aug 26 13:22:27 user nova-compute[73503]: node.session.nr_sessions = 1
Aug 26 13:22:27 user nova-compute[73503]: node.session.auth.authmethod = CHAP
Aug 26 13:22:27 user nova-compute[73503]: node.session.auth.username = qiKESuzs
Aug 26 13:22:27 user nova-compute[73503]: node.session.auth.password = ***
Aug 26 13:22:27 user nova-compute[73503]: node.session.auth.username_in = <empty>
Aug 26 13:22:27 user nova-compute[73503]: node.session.auth.password_in = <empty>
Aug 26 13:22:27 user nova-compute[73503]: node.session.auth.chap_algs = MD5
Aug 26 13:22:27 user nova-compute[73503]: node.session.timeo.replacement_timeout = 120
Aug 26 13:22:27 user nova-compute[73503]: node.session.err_timeo.abort_timeout = 15
Aug 26 13:22:27 user nova-compute[73503]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 13:22:27 user nova-compute[73503]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 13:22:27 user nova-compute[73503]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.FastAbort = Yes
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.InitialR2T = No
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.ImmediateData = Yes
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.MaxConnections = 1
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 13:22:27 user nova-compute[73503]: node.session.iscsi.ERL = 0
Aug 26 13:22:27 user nova-compute[73503]: node.session.scan = manual
Aug 26 13:22:27 user nova-compute[73503]: node.session.reopen_max = 0
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].address = 172.16.0.220
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].port = 3260
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].startup = manual
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].tcp.window_size = 524288
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].tcp.type_of_service = 0
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].timeo.logout_timeout = 15
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].timeo.login_timeout = 15
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].timeo.auth_timeout = 45
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].iscsi.DataDigest = None
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].iscsi.IFMarker = No
Aug 26 13:22:27 user nova-compute[73503]: node.conn[0].iscsi.OFMarker = No
Aug 26 13:22:27 user nova-compute[73503]: # END RECORD
Aug 26 13:22:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3196e-238c-4a25-acae-a5af68ce13a5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d273357-3c93-4896-a3c6-f91bca4305d2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiKESuzs {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qiKESuzs" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7862a0b-f92e-4abc-ad34-78e4578d6b14]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qiKESuzs'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[73329975-9b65-4016-9647-24fd3a7ae36f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd22b1-e0ef-4b46-bdb7-564480de2f32]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:22:27 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:22:27 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:22:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:22:27 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:22:27 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:22:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.180s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] HCTL ('33', '0', '0', 0) found on session 26 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a77f10-5c7c-4fdb-9d34-eb37e67b08e2]: (4, ('0 0 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching for a device in session 26 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== connect_volume: return (205ms) {'type': 'block', 'scsi_wwn': '23563633030646561', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563633030646561', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934835306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934835306',id=22,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-d0e9400p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:20:55Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=6472acd9-81af-48fe-9650-0cfb8146dbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "vif_mac": "fa:16:3e:85:0c:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "vif_mac": "fa:16:3e:85:0c:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'pci_devices' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.objects.base [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<6472acd9-81af-48fe-9650-0cfb8146dbd0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:22:27 user nova-compute[73503]:   <uuid>6472acd9-81af-48fe-9650-0cfb8146dbd0</uuid>
Aug 26 13:22:27 user nova-compute[73503]:   <name>instance-00000016</name>
Aug 26 13:22:27 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:22:27 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:22:27 user nova-compute[73503]:   <metadata>
Aug 26 13:22:27 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:22:27 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:22:27 user nova-compute[73503]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-934835306</nova:name>
Aug 26 13:22:27 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:22:27</nova:creationTime>
Aug 26 13:22:27 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:22:27 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:22:27 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:22:27 user nova-compute[73503]:       <nova:owner>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:user uuid="1a89a1af8a5843ed93bf6f11556e1f65">tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member</nova:user>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:project uuid="9b965a76e3c04068b81deca48c6efba6">tempest-ServerBootFromVolumeStableRescueTest-1652147779</nova:project>
Aug 26 13:22:27 user nova-compute[73503]:       </nova:owner>
Aug 26 13:22:27 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:22:27 user nova-compute[73503]:       <nova:ports>
Aug 26 13:22:27 user nova-compute[73503]:         <nova:port uuid="4fc22ec9-afba-413e-9399-378319124489">
Aug 26 13:22:27 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:22:27 user nova-compute[73503]:         </nova:port>
Aug 26 13:22:27 user nova-compute[73503]:       </nova:ports>
Aug 26 13:22:27 user nova-compute[73503]:     </nova:instance>
Aug 26 13:22:27 user nova-compute[73503]:   </metadata>
Aug 26 13:22:27 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:22:27 user nova-compute[73503]:     <system>
Aug 26 13:22:27 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:22:27 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:22:27 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:22:27 user nova-compute[73503]:       <entry name="serial">6472acd9-81af-48fe-9650-0cfb8146dbd0</entry>
Aug 26 13:22:27 user nova-compute[73503]:       <entry name="uuid">6472acd9-81af-48fe-9650-0cfb8146dbd0</entry>
Aug 26 13:22:27 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:22:27 user nova-compute[73503]:     </system>
Aug 26 13:22:27 user nova-compute[73503]:   </sysinfo>
Aug 26 13:22:27 user nova-compute[73503]:   <os>
Aug 26 13:22:27 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:22:27 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:22:27 user nova-compute[73503]:   </os>
Aug 26 13:22:27 user nova-compute[73503]:   <features>
Aug 26 13:22:27 user nova-compute[73503]:     <acpi/>
Aug 26 13:22:27 user nova-compute[73503]:     <apic/>
Aug 26 13:22:27 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:22:27 user nova-compute[73503]:   </features>
Aug 26 13:22:27 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:22:27 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:22:27 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:22:27 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:22:27 user nova-compute[73503]:   </clock>
Aug 26 13:22:27 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:22:27 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:22:27 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:22:27 user nova-compute[73503]:   </cpu>
Aug 26 13:22:27 user nova-compute[73503]:   <devices>
Aug 26 13:22:27 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:22:27 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:22:27 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:22:27 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:22:27 user nova-compute[73503]:       <serial>4f637674-bc8a-4cf9-9047-5af7b3e4b6be</serial>
Aug 26 13:22:27 user nova-compute[73503]:     </disk>
Aug 26 13:22:27 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:22:27 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:22:27 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue"/>
Aug 26 13:22:27 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:22:27 user nova-compute[73503]:       <boot order="1"/>
Aug 26 13:22:27 user nova-compute[73503]:     </disk>
Aug 26 13:22:27 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:22:27 user nova-compute[73503]:       <mac address="fa:16:3e:85:0c:88"/>
Aug 26 13:22:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:22:27 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:22:27 user nova-compute[73503]:       <target dev="tap4fc22ec9-af"/>
Aug 26 13:22:27 user nova-compute[73503]:     </interface>
Aug 26 13:22:27 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:22:27 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/console.log" append="off"/>
Aug 26 13:22:27 user nova-compute[73503]:     </serial>
Aug 26 13:22:27 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:22:27 user nova-compute[73503]:     <video>
Aug 26 13:22:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:22:27 user nova-compute[73503]:     </video>
Aug 26 13:22:27 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:22:27 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:22:27 user nova-compute[73503]:     </rng>
Aug 26 13:22:27 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:22:27 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:22:27 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:22:27 user nova-compute[73503]:     </memballoon>
Aug 26 13:22:27 user nova-compute[73503]:   </devices>
Aug 26 13:22:27 user nova-compute[73503]: </domain>
Aug 26 13:22:27 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:22:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance destroyed successfully.
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:22:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No VIF found with MAC fa:16:3e:85:0c:88, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-2b23746d-ce54-413b-a838-b209fafc08ed req-a580ad87-7a88-43d3-bcc6-0fef300d53bd service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2b23746d-ce54-413b-a838-b209fafc08ed req-a580ad87-7a88-43d3-bcc6-0fef300d53bd service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2b23746d-ce54-413b-a838-b209fafc08ed req-a580ad87-7a88-43d3-bcc6-0fef300d53bd service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2b23746d-ce54-413b-a838-b209fafc08ed req-a580ad87-7a88-43d3-bcc6-0fef300d53bd service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-2b23746d-ce54-413b-a838-b209fafc08ed req-a580ad87-7a88-43d3-bcc6-0fef300d53bd service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:29 user nova-compute[73503]: WARNING nova.compute.manager [req-2b23746d-ce54-413b-a838-b209fafc08ed req-a580ad87-7a88-43d3-bcc6-0fef300d53bd service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state active and task_state rescuing.
Aug 26 13:22:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 6472acd9-81af-48fe-9650-0cfb8146dbd0 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056151.547199, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:22:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Resumed (Lifecycle Event)
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-815293fe-fa79-4709-9f80-dcb6996cf32c tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:22:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056151.5490174, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:22:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Started (Lifecycle Event)
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-96eaaf0e-cef2-4609-ad97-5b17255217d0 req-9c3b4414-a9e3-4ca1-a816-b432e6b3e47c service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-96eaaf0e-cef2-4609-ad97-5b17255217d0 req-9c3b4414-a9e3-4ca1-a816-b432e6b3e47c service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-96eaaf0e-cef2-4609-ad97-5b17255217d0 req-9c3b4414-a9e3-4ca1-a816-b432e6b3e47c service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-96eaaf0e-cef2-4609-ad97-5b17255217d0 req-9c3b4414-a9e3-4ca1-a816-b432e6b3e47c service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-96eaaf0e-cef2-4609-ad97-5b17255217d0 req-9c3b4414-a9e3-4ca1-a816-b432e6b3e47c service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:31 user nova-compute[73503]: WARNING nova.compute.manager [req-96eaaf0e-cef2-4609-ad97-5b17255217d0 req-9c3b4414-a9e3-4ca1-a816-b432e6b3e47c service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state active and task_state rescuing.
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:22:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:22:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:22:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:54 user nova-compute[73503]: INFO nova.compute.manager [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Terminating instance
Aug 26 13:22:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-bbae2c05-fe80-4104-832b-81ad5e51fdce req-898a04fc-7cf7-473a-a32d-37e4242ef5f2 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-unplugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bbae2c05-fe80-4104-832b-81ad5e51fdce req-898a04fc-7cf7-473a-a32d-37e4242ef5f2 service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bbae2c05-fe80-4104-832b-81ad5e51fdce req-898a04fc-7cf7-473a-a32d-37e4242ef5f2 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bbae2c05-fe80-4104-832b-81ad5e51fdce req-898a04fc-7cf7-473a-a32d-37e4242ef5f2 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-bbae2c05-fe80-4104-832b-81ad5e51fdce req-898a04fc-7cf7-473a-a32d-37e4242ef5f2 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-unplugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-bbae2c05-fe80-4104-832b-81ad5e51fdce req-898a04fc-7cf7-473a-a32d-37e4242ef5f2 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-unplugged-161e50eb-2232-4f63-bb55-c642cb4db883 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Instance destroyed successfully.
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lazy-loading 'resources' on Instance uuid 2a4aee9a-2301-4f73-a1fa-479dfc57893b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T13:19:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-127017182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-127017182',id=20,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfOYYou/IGTrDz2vswL+GqZl/fblIFWALWpWipXrh5TquXBNDoO+OixYAlcsa/XfFOCZbyaJc9gtIgruqT3yvnhABLmHmRmhhef9v+BaR6UPh9nVU7A+etaetIUdL4JPA==',key_name='tempest-keypair-122514547',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8b69eae5d6f48968913dc31408311bb',ramdisk_id='',reservation_id='r-b911rgws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1169990808',owner_user_name='tempest-TaggedAttachmentsTest-1169990808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd620945d8b4acabdf767d34fe696f0',uuid=2a4aee9a-2301-4f73-a1fa-479dfc57893b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converting VIF {"id": "161e50eb-2232-4f63-bb55-c642cb4db883", "address": "fa:16:3e:0e:a6:5c", "network": {"id": "5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2102653948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8b69eae5d6f48968913dc31408311bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap161e50eb-22", "ovs_interfaceid": "161e50eb-2232-4f63-bb55-c642cb4db883", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG os_vif [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap161e50eb-22, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:22:55 user nova-compute[73503]: INFO os_vif [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a6:5c,bridge_name='br-int',has_traffic_filtering=True,id=161e50eb-2232-4f63-bb55-c642cb4db883,network=Network(5e46de0d-3cfb-4f0f-a0bd-bdf7d5a92fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap161e50eb-22')
Aug 26 13:22:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Deleting instance files /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b_del
Aug 26 13:22:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Deletion of /opt/stack/data/nova/instances/2a4aee9a-2301-4f73-a1fa-479dfc57893b_del complete
Aug 26 13:22:55 user nova-compute[73503]: INFO nova.compute.manager [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 13:22:55 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:22:55 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:22:56 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:56 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Took 0.83 seconds to deallocate network for instance.
Aug 26 13:22:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-38307d0e-7e25-40b2-ba78-4eeb28e08e8d req-1e8ef413-0ce4-4623-9471-7b9f013810ee service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-deleted-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:56 user nova-compute[73503]: INFO nova.compute.manager [req-38307d0e-7e25-40b2-ba78-4eeb28e08e8d req-1e8ef413-0ce4-4623-9471-7b9f013810ee service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Neutron deleted interface 161e50eb-2232-4f63-bb55-c642cb4db883; detaching it from the instance and deleting it from the info cache
Aug 26 13:22:56 user nova-compute[73503]: DEBUG nova.network.neutron [req-38307d0e-7e25-40b2-ba78-4eeb28e08e8d req-1e8ef413-0ce4-4623-9471-7b9f013810ee service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:22:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-38307d0e-7e25-40b2-ba78-4eeb28e08e8d req-1e8ef413-0ce4-4623-9471-7b9f013810ee service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Detach interface failed, port_id=161e50eb-2232-4f63-bb55-c642cb4db883, reason: Instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:22:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:57 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Deleted allocations for instance 2a4aee9a-2301-4f73-a1fa-479dfc57893b
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-98ee183a-fef7-416e-b8e8-86569b142f27 tempest-TaggedAttachmentsTest-1169990808 tempest-TaggedAttachmentsTest-1169990808-project-member] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-51f9136e-a43d-4673-84d8-7fb74220a3a1 req-0e626538-6066-4372-9e6b-3fcd6dcd4ee5 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received event network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-51f9136e-a43d-4673-84d8-7fb74220a3a1 req-0e626538-6066-4372-9e6b-3fcd6dcd4ee5 service nova] Acquiring lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-51f9136e-a43d-4673-84d8-7fb74220a3a1 req-0e626538-6066-4372-9e6b-3fcd6dcd4ee5 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-51f9136e-a43d-4673-84d8-7fb74220a3a1 req-0e626538-6066-4372-9e6b-3fcd6dcd4ee5 service nova] Lock "2a4aee9a-2301-4f73-a1fa-479dfc57893b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-51f9136e-a43d-4673-84d8-7fb74220a3a1 req-0e626538-6066-4372-9e6b-3fcd6dcd4ee5 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] No waiting events found dispatching network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:22:57 user nova-compute[73503]: WARNING nova.compute.manager [req-51f9136e-a43d-4673-84d8-7fb74220a3a1 req-0e626538-6066-4372-9e6b-3fcd6dcd4ee5 service nova] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Received unexpected event network-vif-plugged-161e50eb-2232-4f63-bb55-c642cb4db883 for instance with vm_state deleted and task_state None.
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:22:57 user nova-compute[73503]: INFO nova.compute.manager [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Detaching volume 2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb
Aug 26 13:22:57 user nova-compute[73503]: INFO nova.virt.block_device [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Attempting to driver detach volume 2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb from mountpoint /dev/vdc
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Attempting to detach device vdc from instance de9a2cdb-bee4-4901-8dac-34ca47682cdf from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:22:57 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:22:57 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:22:57 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:22:57 user nova-compute[73503]:   <serial>2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb</serial>
Aug 26 13:22:57 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:22:57 user nova-compute[73503]: </disk>
Aug 26 13:22:57 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:22:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully detached device vdc from instance de9a2cdb-bee4-4901-8dac-34ca47682cdf from the persistent domain config.
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance de9a2cdb-bee4-4901-8dac-34ca47682cdf from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:22:57 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:22:57 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:22:57 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:22:57 user nova-compute[73503]:   <serial>2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb</serial>
Aug 26 13:22:57 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:22:57 user nova-compute[73503]: </disk>
Aug 26 13:22:57 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:22:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056178.0753403, de9a2cdb-bee4-4901-8dac-34ca47682cdf => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:22:58 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully detached device vdc from instance de9a2cdb-bee4-4901-8dac-34ca47682cdf from the live domain config.
Aug 26 13:22:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LNYsekUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:22:58 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[301ca099-8995-4306-a1fb-fa253b9ad1eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ead5c1-cea6-4b2a-83f9-312833108071]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:22:58 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:22:58 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:22:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:22:58 user nova-compute[73503]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb (non-flash)
Aug 26 13:22:58 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:22:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31ef89750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d766d87-e9dc-4ccb-b8aa-01bf293e96b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce9cb10-8317-4aaf-8b2e-705a02f42234]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e0564-2e0d-4648-9219-5af88582b262]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa54cd9-c82c-4b1d-acd4-12b04396afd6]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ea7b9-a136-4053-a337-0df0a209e0ac]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b038ab-6360-4904-b74c-1d81bca609fa]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260]
Aug 26 13:22:58 user nova-compute[73503]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb, portal: 172.16.0.220,3260] successful.
Aug 26 13:22:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2adb3ee7-4b35-4daf-92a1-33d6dc6cacbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9b89a9-9648-4167-bb08-5d46b6c10a79]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] <== disconnect_volume: return (275ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:22:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:22:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'flavor' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:22:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ec77a403-a421-4965-9e27-33b49857f018 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-changed-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Refreshing instance network info cache due to event network-changed-8d4a2ae9-81c6-46c2-b949-749cb1976f32. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] Acquiring lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] Acquired lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Refreshing network info cache for port 8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updated VIF entry in instance network info cache for port 8d4a2ae9-81c6-46c2-b949-749cb1976f32. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:23:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating instance_info_cache with network_info: [{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-20546201-d190-4673-899d-44c7e164237c req-f3792a38-f4da-495d-ab8f-f5b897485956 service nova] Releasing lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:23:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:07 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:23:09 user nova-compute[73503]: INFO nova.compute.claims [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Claim successful on node user
Aug 26 13:23:09 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:23:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:23:09 user nova-compute[73503]: INFO nova.virt.block_device [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Booting with volume 60538b82-2d4f-4943-ac10-8b7a8ace56cd at /dev/vda
Aug 26 13:23:09 user nova-compute[73503]: DEBUG nova.policy [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a9851519cfc49c388894f0884261586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f8967f8280045e8b45d9298bda30914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb66a044-58af-41a4-82a1-afa0da6bd82a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[609e08dc-2ec0-4214-94ba-ee876a0104c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6fa50b-91f9-4009-a058-6c7216c07569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[813efb8a-53e9-47b1-bea0-2a6d49e04c04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:23:10 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fff0f56-4894-4658-b710-bd07bd1f640b]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating existing volume attachment record: 3d2605d8-bf03-4d71-93d0-3e6c14de2dd2 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:10 user nova-compute[73503]: INFO nova.compute.manager [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Attaching volume 06b2c1b8-db21-46ba-8979-b57ff7535691 to /dev/vdb
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Successfully created port: 3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056175.6990848, 2a4aee9a-2301-4f73-a1fa-479dfc57893b => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:23:10 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] VM Stopped (Lifecycle Event)
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31e8690-aeb4-46db-847b-90e1927e93fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d7ecbdd6-1e84-4a3e-8dce-4e9613b7042e None None] [instance: 2a4aee9a-2301-4f73-a1fa-479dfc57893b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[599a5ac0-03f4-4570-9ccf-1f4be4fe2b7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[19566da4-7e32-4336-82a7-7e7e518d74e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010bfb6-20f6-4838-8d3e-26016497f1a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:23:10 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:23:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5edbdf-8c2a-4476-b3c6-9e6c7fbfaab1]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:23:10 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating existing volume attachment record: dc3a53e7-0c24-4803-80a7-bb3f9bc8f8d9 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Successfully updated port: 3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquired lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-changed-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Refreshing instance network info cache due to event network-changed-3d573016-adf7-4853-ae4e-12bc20032ad2. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] Acquiring lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Releasing lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance network_info: |[{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] Acquired lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Refreshing network info cache for port 3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updated VIF entry in instance network info cache for port 3d573016-adf7-4853-ae4e-12bc20032ad2. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c7f73fc2-463a-459a-be13-13435290ca1a req-ed5ead45-8b9d-41ee-9a46-a842cc65e03e service nova] Releasing lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:23:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:23:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:23:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:23:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:23:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Creating image(s)
Aug 26 13:23:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Ensure instance console log exists: /opt/stack/data/nova/instances/ac1098c8-c3d6-4f13-9093-3a4100e41299/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Start _get_guest_xml network_info=[{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac1098c8-c3d6-4f13-9093-3a4100e41299', 'attached_at': '', 'detached_at': '', 'volume_id': '60538b82-2d4f-4943-ac10-8b7a8ace56cd', 'serial': '60538b82-2d4f-4943-ac10-8b7a8ace56cd'}, 'attachment_id': '3d2605d8-bf03-4d71-93d0-3e6c14de2dd2', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:23:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:23:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:23:22 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:23:22 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:23:22 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f9a5de-8a86-491e-8eaf-6edb4ff7c4fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:23:22 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ff483-14d2-42dc-b3ec-4eea9c25296e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd] added
Aug 26 13:23:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e9ba7-d3a9-46e2-b621-abe17724c38c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24973dc-c4e2-4893-be7c-17d3e7d94b31]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuhMmAsW {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuhMmAsW" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6459fcd5-6887-4569-9174-de96896af90e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FuhMmAsW'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8836407-db44-469d-aa46-90cc595bece4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f050c-840f-42ad-9080-424b88e2cefe]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:22 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:22 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cdf961-3a7e-4676-819e-62f465635853]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]
Aug 26 13:23:22 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.
Aug 26 13:23:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d24209-f3f5-459d-9070-f959fb3232df]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa3415-1e8f-4ec6-8fec-a687098409a9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:22 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:22 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:22 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:22 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.796s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:23:22 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:23:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:23:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:23:22 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7052MB free_disk=24.966732025146484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4b78c-4964-4df5-83af-2e436ed074ca]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:23:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance de9a2cdb-bee4-4901-8dac-34ca47682cdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 90c4814c-43f2-454f-964b-6179892193c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c7eb91d5-a544-464f-9bd5-26f579f05222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.845s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== connect_volume: return (1847ms) {'type': 'block', 'scsi_wwn': '23066623766646663', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623766646663', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.035s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:23:23 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:23:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:23:23 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:23:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2107938244',display_name='tempest-ServerActionsTestOtherA-server-2107938244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2107938244',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-dfmxnzuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ac1098c8-c3d6-4f13-9093-3a4100e41299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'pci_devices' on Instance uuid ac1098c8-c3d6-4f13-9093-3a4100e41299 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dfa18-a540-4fc7-9658-595f32cfcc81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:23:23 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:23:23 user nova-compute[73503]:   <uuid>ac1098c8-c3d6-4f13-9093-3a4100e41299</uuid>
Aug 26 13:23:23 user nova-compute[73503]:   <name>instance-0000001a</name>
Aug 26 13:23:23 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:23:23 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:23:23 user nova-compute[73503]:   <metadata>
Aug 26 13:23:23 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:23:23 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:23:23 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherA-server-2107938244</nova:name>
Aug 26 13:23:23 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:23:22</nova:creationTime>
Aug 26 13:23:23 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:23:23 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:23:23 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:23:23 user nova-compute[73503]:       <nova:owner>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:user uuid="2a9851519cfc49c388894f0884261586">tempest-ServerActionsTestOtherA-856596274-project-member</nova:user>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:project uuid="9f8967f8280045e8b45d9298bda30914">tempest-ServerActionsTestOtherA-856596274</nova:project>
Aug 26 13:23:23 user nova-compute[73503]:       </nova:owner>
Aug 26 13:23:23 user nova-compute[73503]:       <nova:ports>
Aug 26 13:23:23 user nova-compute[73503]:         <nova:port uuid="3d573016-adf7-4853-ae4e-12bc20032ad2">
Aug 26 13:23:23 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 13:23:23 user nova-compute[73503]:         </nova:port>
Aug 26 13:23:23 user nova-compute[73503]:       </nova:ports>
Aug 26 13:23:23 user nova-compute[73503]:     </nova:instance>
Aug 26 13:23:23 user nova-compute[73503]:   </metadata>
Aug 26 13:23:23 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:23:23 user nova-compute[73503]:     <system>
Aug 26 13:23:23 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:23:23 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:23:23 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:23:23 user nova-compute[73503]:       <entry name="serial">ac1098c8-c3d6-4f13-9093-3a4100e41299</entry>
Aug 26 13:23:23 user nova-compute[73503]:       <entry name="uuid">ac1098c8-c3d6-4f13-9093-3a4100e41299</entry>
Aug 26 13:23:23 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:23:23 user nova-compute[73503]:     </system>
Aug 26 13:23:23 user nova-compute[73503]:   </sysinfo>
Aug 26 13:23:23 user nova-compute[73503]:   <os>
Aug 26 13:23:23 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:23:23 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:23:23 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:23:23 user nova-compute[73503]:   </os>
Aug 26 13:23:23 user nova-compute[73503]:   <features>
Aug 26 13:23:23 user nova-compute[73503]:     <acpi/>
Aug 26 13:23:23 user nova-compute[73503]:     <apic/>
Aug 26 13:23:23 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:23:23 user nova-compute[73503]:   </features>
Aug 26 13:23:23 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:23:23 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:23:23 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:23:23 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:23:23 user nova-compute[73503]:   </clock>
Aug 26 13:23:23 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:23:23 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:23:23 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:23:23 user nova-compute[73503]:   </cpu>
Aug 26 13:23:23 user nova-compute[73503]:   <devices>
Aug 26 13:23:23 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:23:23 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:23:23 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:23:23 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:23:23 user nova-compute[73503]:       <serial>60538b82-2d4f-4943-ac10-8b7a8ace56cd</serial>
Aug 26 13:23:23 user nova-compute[73503]:     </disk>
Aug 26 13:23:23 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:23:23 user nova-compute[73503]:       <mac address="fa:16:3e:5d:bf:6d"/>
Aug 26 13:23:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:23:23 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:23:23 user nova-compute[73503]:       <target dev="tap3d573016-ad"/>
Aug 26 13:23:23 user nova-compute[73503]:     </interface>
Aug 26 13:23:23 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:23:23 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/ac1098c8-c3d6-4f13-9093-3a4100e41299/console.log" append="off"/>
Aug 26 13:23:23 user nova-compute[73503]:     </serial>
Aug 26 13:23:23 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:23:23 user nova-compute[73503]:     <video>
Aug 26 13:23:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:23:23 user nova-compute[73503]:     </video>
Aug 26 13:23:23 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:23:23 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:23:23 user nova-compute[73503]:     </rng>
Aug 26 13:23:23 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:23:23 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:23:23 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:23:23 user nova-compute[73503]:     </memballoon>
Aug 26 13:23:23 user nova-compute[73503]:   </devices>
Aug 26 13:23:23 user nova-compute[73503]: </domain>
Aug 26 13:23:23 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2107938244',display_name='tempest-ServerActionsTestOtherA-server-2107938244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2107938244',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-dfmxnzuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ac1098c8-c3d6-4f13-9093-3a4100e41299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_vif [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d573016-ad, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d573016-ad, col_values=(('external_ids', {'iface-id': '3d573016-adf7-4853-ae4e-12bc20032ad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:bf:6d', 'vm-uuid': 'ac1098c8-c3d6-4f13-9093-3a4100e41299'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af5b45-7465-4085-80f8-dd019827ec2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691] added
Aug 26 13:23:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:24 user nova-compute[73503]: INFO os_vif [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad')
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fe751f-af5c-4135-a4ae-5b42e048c288]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d6804d-039b-41af-b7de-3ca0f5919f61]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmUyJTdS {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No VIF found with MAC fa:16:3e:5d:bf:6d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmUyJTdS" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9d7852-d619-4354-97b7-1e88a28db893]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmUyJTdS'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c2460c-6d1b-49ac-8504-70d18fea2dac]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d475dc6c-2c25-4b05-b99a-7fb24006f832]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad0559-2938-4a11-8c4b-88ea922b8c0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]
Aug 26 13:23:24 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.
Aug 26 13:23:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f5d5d-88b2-4824-9055-a74b3e21149d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b83051-4890-46a3-9390-94c11425da30]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:23:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:24 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:23:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bea206-56b6-4eeb-90aa-d33dd1563bc9]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:23:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== connect_volume: return (2432ms) {'type': 'block', 'scsi_wwn': '26531343361356161', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531343361356161', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:23:25 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:23:25 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:23:25 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:23:25 user nova-compute[73503]:   <serial>06b2c1b8-db21-46ba-8979-b57ff7535691</serial>
Aug 26 13:23:25 user nova-compute[73503]: </disk>
Aug 26 13:23:25 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8ee712d-9389-4e3e-b1f3-1d0f663c8456 req-053050cf-6afa-4743-ac27-8f058ba2f9d3 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8ee712d-9389-4e3e-b1f3-1d0f663c8456 req-053050cf-6afa-4743-ac27-8f058ba2f9d3 service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8ee712d-9389-4e3e-b1f3-1d0f663c8456 req-053050cf-6afa-4743-ac27-8f058ba2f9d3 service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8ee712d-9389-4e3e-b1f3-1d0f663c8456 req-053050cf-6afa-4743-ac27-8f058ba2f9d3 service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8ee712d-9389-4e3e-b1f3-1d0f663c8456 req-053050cf-6afa-4743-ac27-8f058ba2f9d3 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:25 user nova-compute[73503]: WARNING nova.compute.manager [req-e8ee712d-9389-4e3e-b1f3-1d0f663c8456 req-053050cf-6afa-4743-ac27-8f058ba2f9d3 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state building and task_state spawning.
Aug 26 13:23:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No VIF found with MAC fa:16:3e:89:cd:85, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-848b161c-fed9-46c9-96bb-36661fe02409 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.578s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73503) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 13:23:26 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance destroyed successfully.
Aug 26 13:23:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8647ea23-a42a-4952-8a33-a3503503ecee tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:27 user nova-compute[73503]: WARNING nova.compute.manager [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state building and task_state spawning.
Aug 26 13:23:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:27 user nova-compute[73503]: WARNING nova.compute.manager [req-af53ca8e-d7d6-4798-8099-0585b3afc90b req-1800735f-006c-4418-9349-570d4d9270fc service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state None.
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056208.1352742, ac1098c8-c3d6-4f13-9093-3a4100e41299 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] VM Resumed (Lifecycle Event)
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance spawned successfully.
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056208.140695, ac1098c8-c3d6-4f13-9093-3a4100e41299 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] VM Started (Lifecycle Event)
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 26 13:23:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Took 19.05 seconds to build instance.
Aug 26 13:23:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b8364334-7a45-49c7-8ef5-6fd0605cd983 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.142s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-71134e6f-609d-4a06-b554-b44fa74adfa6 req-e7656306-1226-4568-a131-b549ff43e907 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-71134e6f-609d-4a06-b554-b44fa74adfa6 req-e7656306-1226-4568-a131-b549ff43e907 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-71134e6f-609d-4a06-b554-b44fa74adfa6 req-e7656306-1226-4568-a131-b549ff43e907 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-71134e6f-609d-4a06-b554-b44fa74adfa6 req-e7656306-1226-4568-a131-b549ff43e907 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-71134e6f-609d-4a06-b554-b44fa74adfa6 req-e7656306-1226-4568-a131-b549ff43e907 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:29 user nova-compute[73503]: WARNING nova.compute.manager [req-71134e6f-609d-4a06-b554-b44fa74adfa6 req-e7656306-1226-4568-a131-b549ff43e907 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state None.
Aug 26 13:23:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-changed-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Refreshing instance network info cache due to event network-changed-01caaa96-2fd2-4f7b-9089-29ba2c607ff1. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:23:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] Acquiring lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:23:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] Acquired lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:23:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Refreshing network info cache for port 01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:23:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updated VIF entry in instance network info cache for port 01caaa96-2fd2-4f7b-9089-29ba2c607ff1. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:23:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updating instance_info_cache with network_info: [{"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3e99c4c1-6c7d-4ed0-9f78-0d3848ba63b9 req-932eb050-0baa-4c90-a2ad-ce76d628eff1 service nova] Releasing lock "refresh_cache-90c4814c-43f2-454f-964b-6179892193c1" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:23:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:38 user nova-compute[73503]: INFO nova.compute.manager [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Unrescuing
Aug 26 13:23:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:23:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:23:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:23:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'flavor' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 90c4814c-43f2-454f-964b-6179892193c1 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:40 user nova-compute[73503]: INFO nova.compute.manager [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Attaching volume 83f8cc40-22da-48a8-b6f6-8a41970d912e to /dev/vdb
Aug 26 13:23:41 user nova-compute[73503]: DEBUG os_brick.utils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41f8d3c-7083-46f3-b39f-f898b4035411]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a373258d-25d5-4179-b3c4-12858cf81481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8429c-4f9c-44fb-be40-4a555f29a569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea11051-4e62-4262-ba0d-ef92095afc38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a980173-4aff-4aef-8038-b41f4c31183c req-a0098c8c-9ffe-4c80-833b-64f1bcf5c79b service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a980173-4aff-4aef-8038-b41f4c31183c req-a0098c8c-9ffe-4c80-833b-64f1bcf5c79b service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a980173-4aff-4aef-8038-b41f4c31183c req-a0098c8c-9ffe-4c80-833b-64f1bcf5c79b service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a980173-4aff-4aef-8038-b41f4c31183c req-a0098c8c-9ffe-4c80-833b-64f1bcf5c79b service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a980173-4aff-4aef-8038-b41f4c31183c req-a0098c8c-9ffe-4c80-833b-64f1bcf5c79b service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:41 user nova-compute[73503]: WARNING nova.compute.manager [req-3a980173-4aff-4aef-8038-b41f4c31183c req-a0098c8c-9ffe-4c80-833b-64f1bcf5c79b service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:23:41 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:23:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d01cea-ba7e-45a2-be61-0eeecacee204]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG os_brick.utils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:23:41 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updating existing volume attachment record: 1cf4e168-d7d8-4f0c-b5bf-385d4bb3e68b {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:23:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance destroyed successfully.
Aug 26 13:23:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056207.787006, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:23:42 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Stopped (Lifecycle Event)
Aug 26 13:23:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-93c72a73-2305-4b97-b901-2fc035cd8402 None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-93c72a73-2305-4b97-b901-2fc035cd8402 None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:43 user nova-compute[73503]: WARNING nova.compute.manager [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:23:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:43 user nova-compute[73503]: WARNING nova.compute.manager [req-e90b166a-1377-4fb4-b667-4f3bbc33b3f6 req-991651c8-054e-4292-be02-c50d465308e6 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:23:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 2a7f4f67-ae12-4760-b45a-77e9cca24132 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056225.1755583, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:23:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Resumed (Lifecycle Event)
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-376e7c36-5183-4bc9-b949-0f1cc3af495e tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:23:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056225.1792755, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:23:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Started (Lifecycle Event)
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-c6f0ca7b-abd3-4d8f-b508-c791d3717d32 req-02526087-ba60-4749-a6dd-edb59bcd3c00 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c6f0ca7b-abd3-4d8f-b508-c791d3717d32 req-02526087-ba60-4749-a6dd-edb59bcd3c00 service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c6f0ca7b-abd3-4d8f-b508-c791d3717d32 req-02526087-ba60-4749-a6dd-edb59bcd3c00 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c6f0ca7b-abd3-4d8f-b508-c791d3717d32 req-02526087-ba60-4749-a6dd-edb59bcd3c00 service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-c6f0ca7b-abd3-4d8f-b508-c791d3717d32 req-02526087-ba60-4749-a6dd-edb59bcd3c00 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:45 user nova-compute[73503]: WARNING nova.compute.manager [req-c6f0ca7b-abd3-4d8f-b508-c791d3717d32 req-02526087-ba60-4749-a6dd-edb59bcd3c00 service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state None.
Aug 26 13:23:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:47 user nova-compute[73503]: INFO nova.compute.manager [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Terminating instance
Aug 26 13:23:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-c0bdd0ce-9f6f-4089-830c-e6104b2f19a0 req-0cb47996-feba-481d-9af3-9cff113d00d5 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c0bdd0ce-9f6f-4089-830c-e6104b2f19a0 req-0cb47996-feba-481d-9af3-9cff113d00d5 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c0bdd0ce-9f6f-4089-830c-e6104b2f19a0 req-0cb47996-feba-481d-9af3-9cff113d00d5 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c0bdd0ce-9f6f-4089-830c-e6104b2f19a0 req-0cb47996-feba-481d-9af3-9cff113d00d5 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-c0bdd0ce-9f6f-4089-830c-e6104b2f19a0 req-0cb47996-feba-481d-9af3-9cff113d00d5 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-c0bdd0ce-9f6f-4089-830c-e6104b2f19a0 req-0cb47996-feba-481d-9af3-9cff113d00d5 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-unplugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:23:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Instance destroyed successfully.
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'resources' on Instance uuid de9a2cdb-bee4-4901-8dac-34ca47682cdf {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1766659861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1766659861',id=17,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENbUsg30RJnWfw6ueTNmDdKUgT/miUT88A3J6urec/DWGrmHyoXfCoNZLgKuV23u9OFYA3ebJdjZf8D8TeMUNIFTmyK3Ijmasq5/b+dFhAXAvLqzisTxs7nsKcHbpRgKQ==',key_name='tempest-keypair-1321173568',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-jthfuhzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:21:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=de9a2cdb-bee4-4901-8dac-34ca47682cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "address": "fa:16:3e:2d:10:f0", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf4353b-4c", "ovs_interfaceid": "5bf4353b-4c31-4fe2-928b-b765212e20d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG os_vif [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bf4353b-4c, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:48 user nova-compute[73503]: INFO os_vif [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:10:f0,bridge_name='br-int',has_traffic_filtering=True,id=5bf4353b-4c31-4fe2-928b-b765212e20d5,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf4353b-4c')
Aug 26 13:23:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Deleting instance files /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf_del
Aug 26 13:23:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Deletion of /opt/stack/data/nova/instances/de9a2cdb-bee4-4901-8dac-34ca47682cdf_del complete
Aug 26 13:23:48 user nova-compute[73503]: INFO nova.compute.manager [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 13:23:48 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:23:48 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-1bc70711-554d-45b9-8288-c5e120cd1182 req-efc8f48f-baef-4cdc-840e-63a36627a628 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-deleted-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:50 user nova-compute[73503]: INFO nova.compute.manager [req-1bc70711-554d-45b9-8288-c5e120cd1182 req-efc8f48f-baef-4cdc-840e-63a36627a628 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Neutron deleted interface 5bf4353b-4c31-4fe2-928b-b765212e20d5; detaching it from the instance and deleting it from the info cache
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.network.neutron [req-1bc70711-554d-45b9-8288-c5e120cd1182 req-efc8f48f-baef-4cdc-840e-63a36627a628 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:23:50 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Took 1.09 seconds to deallocate network for instance.
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-1bc70711-554d-45b9-8288-c5e120cd1182 req-efc8f48f-baef-4cdc-840e-63a36627a628 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Detach interface failed, port_id=5bf4353b-4c31-4fe2-928b-b765212e20d5, reason: Instance de9a2cdb-bee4-4901-8dac-34ca47682cdf could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:50 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Deleted allocations for instance de9a2cdb-bee4-4901-8dac-34ca47682cdf
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a8cbd1f-3569-4417-aa86-b7cce967f59f req-4553fccf-c27f-4d48-9e11-9a0256fb47b9 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a8cbd1f-3569-4417-aa86-b7cce967f59f req-4553fccf-c27f-4d48-9e11-9a0256fb47b9 service nova] Acquiring lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a8cbd1f-3569-4417-aa86-b7cce967f59f req-4553fccf-c27f-4d48-9e11-9a0256fb47b9 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3a8cbd1f-3569-4417-aa86-b7cce967f59f req-4553fccf-c27f-4d48-9e11-9a0256fb47b9 service nova] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-3a8cbd1f-3569-4417-aa86-b7cce967f59f req-4553fccf-c27f-4d48-9e11-9a0256fb47b9 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] No waiting events found dispatching network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:23:50 user nova-compute[73503]: WARNING nova.compute.manager [req-3a8cbd1f-3569-4417-aa86-b7cce967f59f req-4553fccf-c27f-4d48-9e11-9a0256fb47b9 service nova] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Received unexpected event network-vif-plugged-5bf4353b-4c31-4fe2-928b-b765212e20d5 for instance with vm_state deleted and task_state None.
Aug 26 13:23:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-440cb9d5-22ab-4ae6-b749-13ec80d3ddfd tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "de9a2cdb-bee4-4901-8dac-34ca47682cdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:23:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXsfCQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:23:53 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:23:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:23:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:23:53 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:23:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:23:53 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:23:53 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:23:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[914d5061-9fe8-4dbd-a3b9-90e2b261f4f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:23:54 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c5ff88-90be-4470-8c61-0f024856621f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e] added
Aug 26 13:23:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[434769ef-245e-45c6-91a9-fee9c7c45cd0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.112s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94dac64-2cb7-41f0-ae8a-1b4b98db8c43]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUXsfCQI {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUXsfCQI" returned: 0 in 0.103s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a1488f-3b71-4e60-8785-efb14df0b06c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wUXsfCQI'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[143dcae2-acbe-45f5-8db0-36a5df5158b0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a875e8e9-51f3-44cc-be59-a198dd00bf2d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:23:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:23:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[390544e6-900a-4416-8903-ebed9d4780fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260]
Aug 26 13:23:54 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260] successful.
Aug 26 13:23:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fd4ab5-3cbe-4371-a028-09c3a177d738]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f810101e-95ed-424c-ac6e-b95e37dca4a0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:23:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:23:54 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:23:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27616ac2-e62e-49dc-a5b2-24a213f6f4bf]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:23:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXsfCQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '23436616634623966', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436616634623966', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 90c4814c-43f2-454f-964b-6179892193c1 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:23:55 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:23:55 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:23:55 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:23:55 user nova-compute[73503]:   <serial>83f8cc40-22da-48a8-b6f6-8a41970d912e</serial>
Aug 26 13:23:55 user nova-compute[73503]: </disk>
Aug 26 13:23:55 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:23:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:0a:01:0d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:23:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84cb5a68-940b-40f6-b85c-242fc5caddd5 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.196s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:23:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:23:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2532b05a-30b5-4516-b701-6fbc71e74352" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:24:00 user nova-compute[73503]: INFO nova.compute.claims [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Claim successful on node user
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.network.neutron [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:24:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:24:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG nova.policy [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8239f95979394225b8c80579a8121631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e80f2c62e0a4494816b02e60073bb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:24:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Creating image(s)
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "/opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk 1073741824" returned: 0 in 0.057s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.244s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:01 user nova-compute[73503]: DEBUG nova.network.neutron [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Successfully created port: c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Cannot resize image /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Ensure instance console log exists: /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Successfully updated port: c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquired lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-changed-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Refreshing instance network info cache due to event network-changed-c5c78c00-058e-41ea-af3a-af42ac631c31. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] Acquiring lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056228.787576, de9a2cdb-bee4-4901-8dac-34ca47682cdf => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:03 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] VM Stopped (Lifecycle Event)
Aug 26 13:24:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-93cc011b-d7a8-4eea-9349-f86f8f0d1532 None None] [instance: de9a2cdb-bee4-4901-8dac-34ca47682cdf] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.neutron [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Updating instance_info_cache with network_info: [{"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Releasing lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Instance network_info: |[{"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] Acquired lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Refreshing network info cache for port c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Start _get_guest_xml network_info=[{"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:24:04 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:04 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874120062',display_name='tempest-AttachVolumeNegativeTest-server-874120062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874120062',id=27,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXYnvSb2y7vcC9UEs9E0x6blyQRqwswCG2x9yv8Z89LHBItMV4kcli42KhbgmIY3tTYOhWNbFSwHjc402fJxQmLkMr8FdNiVll4TxUSAFAORckzIoCzYmH/nlLG2iCPug==',key_name='tempest-keypair-1687127282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-lva186o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=2532b05a-30b5-4516-b701-6fbc71e74352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'pci_devices' on Instance uuid 2532b05a-30b5-4516-b701-6fbc71e74352 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:24:04 user nova-compute[73503]:   <uuid>2532b05a-30b5-4516-b701-6fbc71e74352</uuid>
Aug 26 13:24:04 user nova-compute[73503]:   <name>instance-0000001b</name>
Aug 26 13:24:04 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:24:04 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:24:04 user nova-compute[73503]:   <metadata>
Aug 26 13:24:04 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:24:04 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:24:04 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeNegativeTest-server-874120062</nova:name>
Aug 26 13:24:04 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:24:04</nova:creationTime>
Aug 26 13:24:04 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:24:04 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:24:04 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:24:04 user nova-compute[73503]:       <nova:owner>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:user uuid="8239f95979394225b8c80579a8121631">tempest-AttachVolumeNegativeTest-2059589668-project-member</nova:user>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:project uuid="3e80f2c62e0a4494816b02e60073bb0e">tempest-AttachVolumeNegativeTest-2059589668</nova:project>
Aug 26 13:24:04 user nova-compute[73503]:       </nova:owner>
Aug 26 13:24:04 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:24:04 user nova-compute[73503]:       <nova:ports>
Aug 26 13:24:04 user nova-compute[73503]:         <nova:port uuid="c5c78c00-058e-41ea-af3a-af42ac631c31">
Aug 26 13:24:04 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 13:24:04 user nova-compute[73503]:         </nova:port>
Aug 26 13:24:04 user nova-compute[73503]:       </nova:ports>
Aug 26 13:24:04 user nova-compute[73503]:     </nova:instance>
Aug 26 13:24:04 user nova-compute[73503]:   </metadata>
Aug 26 13:24:04 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:24:04 user nova-compute[73503]:     <system>
Aug 26 13:24:04 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:24:04 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:24:04 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:24:04 user nova-compute[73503]:       <entry name="serial">2532b05a-30b5-4516-b701-6fbc71e74352</entry>
Aug 26 13:24:04 user nova-compute[73503]:       <entry name="uuid">2532b05a-30b5-4516-b701-6fbc71e74352</entry>
Aug 26 13:24:04 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:24:04 user nova-compute[73503]:     </system>
Aug 26 13:24:04 user nova-compute[73503]:   </sysinfo>
Aug 26 13:24:04 user nova-compute[73503]:   <os>
Aug 26 13:24:04 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:24:04 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:24:04 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:24:04 user nova-compute[73503]:   </os>
Aug 26 13:24:04 user nova-compute[73503]:   <features>
Aug 26 13:24:04 user nova-compute[73503]:     <acpi/>
Aug 26 13:24:04 user nova-compute[73503]:     <apic/>
Aug 26 13:24:04 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:24:04 user nova-compute[73503]:   </features>
Aug 26 13:24:04 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:24:04 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:24:04 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:24:04 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:24:04 user nova-compute[73503]:   </clock>
Aug 26 13:24:04 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:24:04 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:24:04 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:24:04 user nova-compute[73503]:   </cpu>
Aug 26 13:24:04 user nova-compute[73503]:   <devices>
Aug 26 13:24:04 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:24:04 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:24:04 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk"/>
Aug 26 13:24:04 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:24:04 user nova-compute[73503]:     </disk>
Aug 26 13:24:04 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:24:04 user nova-compute[73503]:       <mac address="fa:16:3e:76:de:c1"/>
Aug 26 13:24:04 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:04 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:24:04 user nova-compute[73503]:       <target dev="tapc5c78c00-05"/>
Aug 26 13:24:04 user nova-compute[73503]:     </interface>
Aug 26 13:24:04 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:24:04 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/console.log" append="off"/>
Aug 26 13:24:04 user nova-compute[73503]:     </serial>
Aug 26 13:24:04 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:24:04 user nova-compute[73503]:     <video>
Aug 26 13:24:04 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:04 user nova-compute[73503]:     </video>
Aug 26 13:24:04 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:24:04 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:24:04 user nova-compute[73503]:     </rng>
Aug 26 13:24:04 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:24:04 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:24:04 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:24:04 user nova-compute[73503]:     </memballoon>
Aug 26 13:24:04 user nova-compute[73503]:   </devices>
Aug 26 13:24:04 user nova-compute[73503]: </domain>
Aug 26 13:24:04 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874120062',display_name='tempest-AttachVolumeNegativeTest-server-874120062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874120062',id=27,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXYnvSb2y7vcC9UEs9E0x6blyQRqwswCG2x9yv8Z89LHBItMV4kcli42KhbgmIY3tTYOhWNbFSwHjc402fJxQmLkMr8FdNiVll4TxUSAFAORckzIoCzYmH/nlLG2iCPug==',key_name='tempest-keypair-1687127282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-lva186o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=2532b05a-30b5-4516-b701-6fbc71e74352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG os_vif [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5c78c00-05, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5c78c00-05, col_values=(('external_ids', {'iface-id': 'c5c78c00-058e-41ea-af3a-af42ac631c31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:de:c1', 'vm-uuid': '2532b05a-30b5-4516-b701-6fbc71e74352'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:04 user nova-compute[73503]: INFO os_vif [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05')
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:76:de:c1, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Updated VIF entry in instance network info cache for port c5c78c00-058e-41ea-af3a-af42ac631c31. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Updating instance_info_cache with network_info: [{"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-efbaf07c-754d-40b8-9d51-9ed060db9fbf req-90308992-1050-42ae-9004-86f84102dfb9 service nova] Releasing lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "d13159b8-3de6-4480-9762-df9c558096f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:05 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:24:05 user nova-compute[73503]: INFO nova.compute.claims [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Claim successful on node user
Aug 26 13:24:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-612b7414-6643-48c8-b265-a4982f8d7065 req-a20e3096-006a-47c8-b6b1-b052abd993c9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-612b7414-6643-48c8-b265-a4982f8d7065 req-a20e3096-006a-47c8-b6b1-b052abd993c9 service nova] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-612b7414-6643-48c8-b265-a4982f8d7065 req-a20e3096-006a-47c8-b6b1-b052abd993c9 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-612b7414-6643-48c8-b265-a4982f8d7065 req-a20e3096-006a-47c8-b6b1-b052abd993c9 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-612b7414-6643-48c8-b265-a4982f8d7065 req-a20e3096-006a-47c8-b6b1-b052abd993c9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] No waiting events found dispatching network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:06 user nova-compute[73503]: WARNING nova.compute.manager [req-612b7414-6643-48c8-b265-a4982f8d7065 req-a20e3096-006a-47c8-b6b1-b052abd993c9 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received unexpected event network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 for instance with vm_state building and task_state spawning.
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.network.neutron [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:24:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:24:06 user nova-compute[73503]: DEBUG nova.policy [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122b92a79d3242f2903b15430240eace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c42bf18354f55954102eed4da2d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:24:06 user nova-compute[73503]: INFO nova.virt.block_device [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Booting with volume snapshot 14b4ab38-3748-42cd-981f-147f373d9b08 at /dev/vda
Aug 26 13:24:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Successfully created port: b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:24:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:07 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056247.9951441, 2532b05a-30b5-4516-b701-6fbc71e74352 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:07 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] VM Resumed (Lifecycle Event)
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:24:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Instance spawned successfully.
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:08 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056247.996371, 2532b05a-30b5-4516-b701-6fbc71e74352 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:08 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] VM Started (Lifecycle Event)
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:08 user nova-compute[73503]: INFO nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Took 7.07 seconds to spawn the instance on the hypervisor.
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:08 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-72d53706-27c0-4b66-a830-8725eb2ddd4e req-64e10bd0-452e-479e-9e9d-52c99c7b3e25 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-72d53706-27c0-4b66-a830-8725eb2ddd4e req-64e10bd0-452e-479e-9e9d-52c99c7b3e25 service nova] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-72d53706-27c0-4b66-a830-8725eb2ddd4e req-64e10bd0-452e-479e-9e9d-52c99c7b3e25 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-72d53706-27c0-4b66-a830-8725eb2ddd4e req-64e10bd0-452e-479e-9e9d-52c99c7b3e25 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-72d53706-27c0-4b66-a830-8725eb2ddd4e req-64e10bd0-452e-479e-9e9d-52c99c7b3e25 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] No waiting events found dispatching network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:08 user nova-compute[73503]: WARNING nova.compute.manager [req-72d53706-27c0-4b66-a830-8725eb2ddd4e req-64e10bd0-452e-479e-9e9d-52c99c7b3e25 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received unexpected event network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 for instance with vm_state building and task_state spawning.
Aug 26 13:24:08 user nova-compute[73503]: INFO nova.compute.manager [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Took 8.04 seconds to build instance.
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-99a2be44-8ce1-4a06-b922-479a6066d145 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2532b05a-30b5-4516-b701-6fbc71e74352" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.178s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Successfully updated port: b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "refresh_cache-d13159b8-3de6-4480-9762-df9c558096f3" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquired lock "refresh_cache-d13159b8-3de6-4480-9762-df9c558096f3" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-changed-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Refreshing instance network info cache due to event network-changed-7e469415-9c9e-4677-9fc2-aef5ee3b0aed. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] Acquiring lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] Acquired lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.network.neutron [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Refreshing network info cache for port 7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:24:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Updating instance_info_cache with network_info: [{"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Releasing lock "refresh_cache-d13159b8-3de6-4480-9762-df9c558096f3" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Instance network_info: |[{"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG nova.objects.instance [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'flavor' on Instance uuid c7eb91d5-a544-464f-9bd5-26f579f05222 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updated VIF entry in instance network info cache for port 7e469415-9c9e-4677-9fc2-aef5ee3b0aed. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updating instance_info_cache with network_info: [{"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f4329a64-3f3b-496b-b5c1-ffce6a1e5e0f req-29835432-7004-4a36-a45c-174db1586257 service nova] Releasing lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:09 user nova-compute[73503]: INFO nova.compute.manager [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Attaching volume 397201d5-ce48-4c81-8cac-9beebc512df0 to /dev/vdb
Aug 26 13:24:09 user nova-compute[73503]: DEBUG os_brick.utils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9e9c20-e66e-4a3c-834c-7fce0244c88c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cd3d1a-0a26-4fd0-862c-a6028b89101a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f058949-a4b6-447e-80f3-fbfd25ab73b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf9cb9-7f45-4b58-a4e2-ceeb939ad1be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:24:10 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45d4d73-c8a0-4721-8c60-a828cc96bb5e]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updating existing volume attachment record: 90e11c92-bae0-480e-aeaa-538e535ad02a {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-changed-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Refreshing instance network info cache due to event network-changed-b490812e-c54d-47ce-b1c2-a1a941161a87. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] Acquiring lock "refresh_cache-d13159b8-3de6-4480-9762-df9c558096f3" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] Acquired lock "refresh_cache-d13159b8-3de6-4480-9762-df9c558096f3" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Refreshing network info cache for port b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:24:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Updated VIF entry in instance network info cache for port b490812e-c54d-47ce-b1c2-a1a941161a87. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:24:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Updating instance_info_cache with network_info: [{"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-460477d8-a95a-4aed-9c92-1472dd735065 req-e671c91e-75f8-4fa2-90f7-3a525967cc25 service nova] Releasing lock "refresh_cache-d13159b8-3de6-4480-9762-df9c558096f3" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG os_brick.utils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[069462d0-563c-4c08-aa1e-2a7185b84376]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2b8749-5186-493f-b7ef-3a945f47b567]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e5e09-85ed-40ca-b91f-3668bc60e991]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[503a6799-8965-4a07-91bf-e9c2c2060a01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:24:12 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a3d37e-e63d-4c6f-a30e-76dad7741f56]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG os_brick.utils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Updating existing volume attachment record: 7d8fe35a-03f6-4546-869e-90222d44d387 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:14 user nova-compute[73503]: INFO nova.compute.manager [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Unrescuing
Aug 26 13:24:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:24:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG nova.objects.instance [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'flavor' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-8873df06-4524-4b26-acc5-c8178423f556 req-ed0746be-15ef-4bb0-8525-3ff2c44409eb service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8873df06-4524-4b26-acc5-c8178423f556 req-ed0746be-15ef-4bb0-8525-3ff2c44409eb service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8873df06-4524-4b26-acc5-c8178423f556 req-ed0746be-15ef-4bb0-8525-3ff2c44409eb service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8873df06-4524-4b26-acc5-c8178423f556 req-ed0746be-15ef-4bb0-8525-3ff2c44409eb service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-8873df06-4524-4b26-acc5-c8178423f556 req-ed0746be-15ef-4bb0-8525-3ff2c44409eb service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:15 user nova-compute[73503]: WARNING nova.compute.manager [req-8873df06-4524-4b26-acc5-c8178423f556 req-ed0746be-15ef-4bb0-8525-3ff2c44409eb service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:24:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance destroyed successfully.
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-3e9c9352-868b-446c-8fdb-18d7b45a1d20 req-56e3706e-9531-4215-892a-09120e478af5 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3e9c9352-868b-446c-8fdb-18d7b45a1d20 req-56e3706e-9531-4215-892a-09120e478af5 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3e9c9352-868b-446c-8fdb-18d7b45a1d20 req-56e3706e-9531-4215-892a-09120e478af5 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3e9c9352-868b-446c-8fdb-18d7b45a1d20 req-56e3706e-9531-4215-892a-09120e478af5 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-3e9c9352-868b-446c-8fdb-18d7b45a1d20 req-56e3706e-9531-4215-892a-09120e478af5 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:17 user nova-compute[73503]: WARNING nova.compute.manager [req-3e9c9352-868b-446c-8fdb-18d7b45a1d20 req-56e3706e-9531-4215-892a-09120e478af5 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:19 user nova-compute[73503]: WARNING nova.compute.manager [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:24:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:19 user nova-compute[73503]: WARNING nova.compute.manager [req-f3fa3802-2472-41d1-936a-7bb5952def37 req-8576cee8-8a7d-4029-b756-7a11c3ab7e5f service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:24:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 6472acd9-81af-48fe-9650-0cfb8146dbd0 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056260.1184149, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Resumed (Lifecycle Event)
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-922e0269-5214-4886-9c43-533fc9448123 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056260.1315408, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Started (Lifecycle Event)
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "9c247e08-3242-4197-9266-15ebf49a7397" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:24:22 user nova-compute[73503]: INFO nova.compute.claims [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Claim successful on node user
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.888s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:24:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.policy [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd36de042b19421e892868e57b21c95d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a226ec6751458f9641e74bf28ff17d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:24:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Creating image(s)
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "/opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "/opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.622s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Successfully created port: b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIOiXUol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:24:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:24:24 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:24:24 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7261MB free_disk=24.96982192993164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[659148b2-d7f5-429d-b2d8-05eeb761406d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:24:24 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d936f7-2002-4aca-a3a3-c39d2624fbf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0] added
Aug 26 13:24:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f2f005-592f-418d-bedc-0431af72289a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312bb48-632b-4ae8-9b0f-82d9a84ead2f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIOiXUol {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIOiXUol" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[917c5c46-3f5c-4297-92ff-79e84add74d1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eIOiXUol'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d6d1f1-6141-4482-acc5-5c2b0635597d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 90c4814c-43f2-454f-964b-6179892193c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c7eb91d5-a544-464f-9bd5-26f579f05222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2532b05a-30b5-4516-b701-6fbc71e74352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d13159b8-3de6-4480-9762-df9c558096f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9c247e08-3242-4197-9266-15ebf49a7397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk 1073741824" returned: 0 in 0.061s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a96667-433d-42e8-b56a-e431b87cbb6d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e747f28a-f1ef-40c2-9fca-be11c478edc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260]
Aug 26 13:24:24 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260] successful.
Aug 26 13:24:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54bbad9-9994-4376-84d2-06d6ae5cf6cb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca9e1f-912a-4c6d-81d1-d609ba950634]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:24 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:24 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08af292-c0f9-4cf1-994d-93aef8963ead]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:24:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIOiXUol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Cannot resize image /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Ensure instance console log exists: /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.749s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Successfully updated port: b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "refresh_cache-9c247e08-3242-4197-9266-15ebf49a7397" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquired lock "refresh_cache-9c247e08-3242-4197-9266-15ebf49a7397" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-changed-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Refreshing instance network info cache due to event network-changed-b292dcbd-1b73-45db-9e48-4e09424d21b7. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] Acquiring lock "refresh_cache-9c247e08-3242-4197-9266-15ebf49a7397" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.neutron [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Updating instance_info_cache with network_info: [{"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Releasing lock "refresh_cache-9c247e08-3242-4197-9266-15ebf49a7397" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Instance network_info: |[{"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] Acquired lock "refresh_cache-9c247e08-3242-4197-9266-15ebf49a7397" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Refreshing network info cache for port b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Start _get_guest_xml network_info=[{"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:24:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1082484482',display_name='tempest-VolumesActionsTest-instance-1082484482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1082484482',id=29,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a226ec6751458f9641e74bf28ff17d',ramdisk_id='',reservation_id='r-60s7v9cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1770898695',owner_user_name='tempest-VolumesActionsTest-1770898695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:24Z,user_data=None,user_id='cd36de042b19421e892868e57b21c95d',uuid=9c247e08-3242-4197-9266-15ebf49a7397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Converting VIF {"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c247e08-3242-4197-9266-15ebf49a7397 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:24:25 user nova-compute[73503]:   <uuid>9c247e08-3242-4197-9266-15ebf49a7397</uuid>
Aug 26 13:24:25 user nova-compute[73503]:   <name>instance-0000001d</name>
Aug 26 13:24:25 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:24:25 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:24:25 user nova-compute[73503]:   <metadata>
Aug 26 13:24:25 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:24:25 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:24:25 user nova-compute[73503]:       <nova:name>tempest-VolumesActionsTest-instance-1082484482</nova:name>
Aug 26 13:24:25 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:24:25</nova:creationTime>
Aug 26 13:24:25 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:24:25 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:24:25 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:24:25 user nova-compute[73503]:       <nova:owner>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:user uuid="cd36de042b19421e892868e57b21c95d">tempest-VolumesActionsTest-1770898695-project-member</nova:user>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:project uuid="36a226ec6751458f9641e74bf28ff17d">tempest-VolumesActionsTest-1770898695</nova:project>
Aug 26 13:24:25 user nova-compute[73503]:       </nova:owner>
Aug 26 13:24:25 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:24:25 user nova-compute[73503]:       <nova:ports>
Aug 26 13:24:25 user nova-compute[73503]:         <nova:port uuid="b292dcbd-1b73-45db-9e48-4e09424d21b7">
Aug 26 13:24:25 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 13:24:25 user nova-compute[73503]:         </nova:port>
Aug 26 13:24:25 user nova-compute[73503]:       </nova:ports>
Aug 26 13:24:25 user nova-compute[73503]:     </nova:instance>
Aug 26 13:24:25 user nova-compute[73503]:   </metadata>
Aug 26 13:24:25 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:24:25 user nova-compute[73503]:     <system>
Aug 26 13:24:25 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:24:25 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:24:25 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:24:25 user nova-compute[73503]:       <entry name="serial">9c247e08-3242-4197-9266-15ebf49a7397</entry>
Aug 26 13:24:25 user nova-compute[73503]:       <entry name="uuid">9c247e08-3242-4197-9266-15ebf49a7397</entry>
Aug 26 13:24:25 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:24:25 user nova-compute[73503]:     </system>
Aug 26 13:24:25 user nova-compute[73503]:   </sysinfo>
Aug 26 13:24:25 user nova-compute[73503]:   <os>
Aug 26 13:24:25 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:24:25 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:24:25 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:24:25 user nova-compute[73503]:   </os>
Aug 26 13:24:25 user nova-compute[73503]:   <features>
Aug 26 13:24:25 user nova-compute[73503]:     <acpi/>
Aug 26 13:24:25 user nova-compute[73503]:     <apic/>
Aug 26 13:24:25 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:24:25 user nova-compute[73503]:   </features>
Aug 26 13:24:25 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:24:25 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:24:25 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:24:25 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:24:25 user nova-compute[73503]:   </clock>
Aug 26 13:24:25 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:24:25 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:24:25 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:24:25 user nova-compute[73503]:   </cpu>
Aug 26 13:24:25 user nova-compute[73503]:   <devices>
Aug 26 13:24:25 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:24:25 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:24:25 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk"/>
Aug 26 13:24:25 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:24:25 user nova-compute[73503]:     </disk>
Aug 26 13:24:25 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:24:25 user nova-compute[73503]:       <mac address="fa:16:3e:e8:0f:cb"/>
Aug 26 13:24:25 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:25 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:24:25 user nova-compute[73503]:       <target dev="tapb292dcbd-1b"/>
Aug 26 13:24:25 user nova-compute[73503]:     </interface>
Aug 26 13:24:25 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:24:25 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/console.log" append="off"/>
Aug 26 13:24:25 user nova-compute[73503]:     </serial>
Aug 26 13:24:25 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:24:25 user nova-compute[73503]:     <video>
Aug 26 13:24:25 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:25 user nova-compute[73503]:     </video>
Aug 26 13:24:25 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:24:25 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:24:25 user nova-compute[73503]:     </rng>
Aug 26 13:24:25 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:24:25 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:24:25 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:24:25 user nova-compute[73503]:     </memballoon>
Aug 26 13:24:25 user nova-compute[73503]:   </devices>
Aug 26 13:24:25 user nova-compute[73503]: </domain>
Aug 26 13:24:25 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1082484482',display_name='tempest-VolumesActionsTest-instance-1082484482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1082484482',id=29,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a226ec6751458f9641e74bf28ff17d',ramdisk_id='',reservation_id='r-60s7v9cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1770898695',owner_user_name='tempest-VolumesActionsTest-1770898695-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:24Z,user_data=None,user_id='cd36de042b19421e892868e57b21c95d',uuid=9c247e08-3242-4197-9266-15ebf49a7397,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Converting VIF {"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG os_vif [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb292dcbd-1b, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb292dcbd-1b, col_values=(('external_ids', {'iface-id': 'b292dcbd-1b73-45db-9e48-4e09424d21b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:0f:cb', 'vm-uuid': '9c247e08-3242-4197-9266-15ebf49a7397'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:25 user nova-compute[73503]: INFO os_vif [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b')
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] No VIF found with MAC fa:16:3e:e8:0f:cb, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23630346535636464', 'path': '/dev/sdg'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630346535636464', 'path': '/dev/sdg'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.objects.instance [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'flavor' on Instance uuid c7eb91d5-a544-464f-9bd5-26f579f05222 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:24:25 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:24:25 user nova-compute[73503]:   <source dev="/dev/sdg"/>
Aug 26 13:24:25 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:24:25 user nova-compute[73503]:   <serial>397201d5-ce48-4c81-8cac-9beebc512df0</serial>
Aug 26 13:24:25 user nova-compute[73503]: </disk>
Aug 26 13:24:25 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:24:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Creating image(s)
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Ensure instance console log exists: /opt/stack/data/nova/instances/d13159b8-3de6-4480-9762-df9c558096f3/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Start _get_guest_xml network_info=[{"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbmlBvpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd13159b8-3de6-4480-9762-df9c558096f3', 'attached_at': '', 'detached_at': '', 'volume_id': '7dfda802-6e1b-4e74-a56f-d07b5ac11b13', 'serial': '7dfda802-6e1b-4e74-a56f-d07b5ac11b13'}, 'attachment_id': '7d8fe35a-03f6-4546-869e-90222d44d387', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:24:26 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:26 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbmlBvpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:24:26 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:24:26 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:24:26 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28447c60-eced-4be5-9d63-202a114d06f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:24:26 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab4adf-a353-4893-a6ff-ef4e315e1b21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13] added
Aug 26 13:24:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d080d-1147-4305-ab2f-c714139ee889]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93ec808-3200-488a-b3f5-619a2e31ba29]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dbmlBvpC {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dbmlBvpC" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[520143df-b653-484d-95c5-cebe44f761b1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dbmlBvpC'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de91bf6-2af6-47df-9f33-10ed96636379]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4cd19c-c437-44b8-8134-8fc0633ce657]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a690d8-703c-458b-ae38-31e78f86f534]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Updated VIF entry in instance network info cache for port b292dcbd-1b73-45db-9e48-4e09424d21b7. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Updating instance_info_cache with network_info: [{"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260]
Aug 26 13:24:26 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260] successful.
Aug 26 13:24:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] No VIF found with MAC fa:16:3e:94:90:9c, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[429fe0e1-8af2-4950-a384-368eb74fef0f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3f3414fb-3e45-4fd0-b578-c43851d64034 req-22db9e70-cafa-4284-9bcb-4ba34d4fff1e service nova] Releasing lock "refresh_cache-9c247e08-3242-4197-9266-15ebf49a7397" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1321f87e-3d6e-4a4c-8710-802ad3864110]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:24:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f536ff7-3c1a-4624-b206-2feb81ed6557]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbmlBvpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-372b0f12-47a7-4c53-bf22-725b7b9e7050 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.854s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating instance_info_cache with network_info: [{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23234333464653233', 'path': '/dev/sdh'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234333464653233', 'path': '/dev/sdh'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-432592566',display_name='tempest-TestVolumeBootPattern-server-432592566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-432592566',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-lx4bo9fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:07Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=d13159b8-3de6-4480-9762-df9c558096f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'pci_devices' on Instance uuid d13159b8-3de6-4480-9762-df9c558096f3 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:24:27 user nova-compute[73503]:   <uuid>d13159b8-3de6-4480-9762-df9c558096f3</uuid>
Aug 26 13:24:27 user nova-compute[73503]:   <name>instance-0000001c</name>
Aug 26 13:24:27 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:24:27 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:24:27 user nova-compute[73503]:   <metadata>
Aug 26 13:24:27 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:24:27 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:24:27 user nova-compute[73503]:       <nova:name>tempest-TestVolumeBootPattern-server-432592566</nova:name>
Aug 26 13:24:27 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:24:26</nova:creationTime>
Aug 26 13:24:27 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:24:27 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:24:27 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:24:27 user nova-compute[73503]:       <nova:owner>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:user uuid="122b92a79d3242f2903b15430240eace">tempest-TestVolumeBootPattern-813053503-project-member</nova:user>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:project uuid="c56c42bf18354f55954102eed4da2d58">tempest-TestVolumeBootPattern-813053503</nova:project>
Aug 26 13:24:27 user nova-compute[73503]:       </nova:owner>
Aug 26 13:24:27 user nova-compute[73503]:       <nova:ports>
Aug 26 13:24:27 user nova-compute[73503]:         <nova:port uuid="b490812e-c54d-47ce-b1c2-a1a941161a87">
Aug 26 13:24:27 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 13:24:27 user nova-compute[73503]:         </nova:port>
Aug 26 13:24:27 user nova-compute[73503]:       </nova:ports>
Aug 26 13:24:27 user nova-compute[73503]:     </nova:instance>
Aug 26 13:24:27 user nova-compute[73503]:   </metadata>
Aug 26 13:24:27 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:24:27 user nova-compute[73503]:     <system>
Aug 26 13:24:27 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:24:27 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:24:27 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:24:27 user nova-compute[73503]:       <entry name="serial">d13159b8-3de6-4480-9762-df9c558096f3</entry>
Aug 26 13:24:27 user nova-compute[73503]:       <entry name="uuid">d13159b8-3de6-4480-9762-df9c558096f3</entry>
Aug 26 13:24:27 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:24:27 user nova-compute[73503]:     </system>
Aug 26 13:24:27 user nova-compute[73503]:   </sysinfo>
Aug 26 13:24:27 user nova-compute[73503]:   <os>
Aug 26 13:24:27 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:24:27 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:24:27 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:24:27 user nova-compute[73503]:   </os>
Aug 26 13:24:27 user nova-compute[73503]:   <features>
Aug 26 13:24:27 user nova-compute[73503]:     <acpi/>
Aug 26 13:24:27 user nova-compute[73503]:     <apic/>
Aug 26 13:24:27 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:24:27 user nova-compute[73503]:   </features>
Aug 26 13:24:27 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:24:27 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:24:27 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:24:27 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:24:27 user nova-compute[73503]:   </clock>
Aug 26 13:24:27 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:24:27 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:24:27 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:24:27 user nova-compute[73503]:   </cpu>
Aug 26 13:24:27 user nova-compute[73503]:   <devices>
Aug 26 13:24:27 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:24:27 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:24:27 user nova-compute[73503]:       <source dev="/dev/sdh"/>
Aug 26 13:24:27 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:24:27 user nova-compute[73503]:       <serial>7dfda802-6e1b-4e74-a56f-d07b5ac11b13</serial>
Aug 26 13:24:27 user nova-compute[73503]:     </disk>
Aug 26 13:24:27 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:24:27 user nova-compute[73503]:       <mac address="fa:16:3e:cd:12:f8"/>
Aug 26 13:24:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:27 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:24:27 user nova-compute[73503]:       <target dev="tapb490812e-c5"/>
Aug 26 13:24:27 user nova-compute[73503]:     </interface>
Aug 26 13:24:27 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:24:27 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/d13159b8-3de6-4480-9762-df9c558096f3/console.log" append="off"/>
Aug 26 13:24:27 user nova-compute[73503]:     </serial>
Aug 26 13:24:27 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:24:27 user nova-compute[73503]:     <video>
Aug 26 13:24:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:27 user nova-compute[73503]:     </video>
Aug 26 13:24:27 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:24:27 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:24:27 user nova-compute[73503]:     </rng>
Aug 26 13:24:27 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:24:27 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:24:27 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:24:27 user nova-compute[73503]:     </memballoon>
Aug 26 13:24:27 user nova-compute[73503]:   </devices>
Aug 26 13:24:27 user nova-compute[73503]: </domain>
Aug 26 13:24:27 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-432592566',display_name='tempest-TestVolumeBootPattern-server-432592566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-432592566',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-lx4bo9fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:07Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=d13159b8-3de6-4480-9762-df9c558096f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG os_vif [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb490812e-c5, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb490812e-c5, col_values=(('external_ids', {'iface-id': 'b490812e-c54d-47ce-b1c2-a1a941161a87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:12:f8', 'vm-uuid': 'd13159b8-3de6-4480-9762-df9c558096f3'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-41bd164a-91d3-4e74-8f6d-c3d98942c590 req-9aeaf506-aeea-444d-8053-05642ea4be31 service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-41bd164a-91d3-4e74-8f6d-c3d98942c590 req-9aeaf506-aeea-444d-8053-05642ea4be31 service nova] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-41bd164a-91d3-4e74-8f6d-c3d98942c590 req-9aeaf506-aeea-444d-8053-05642ea4be31 service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-41bd164a-91d3-4e74-8f6d-c3d98942c590 req-9aeaf506-aeea-444d-8053-05642ea4be31 service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-41bd164a-91d3-4e74-8f6d-c3d98942c590 req-9aeaf506-aeea-444d-8053-05642ea4be31 service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] No waiting events found dispatching network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:27 user nova-compute[73503]: WARNING nova.compute.manager [req-41bd164a-91d3-4e74-8f6d-c3d98942c590 req-9aeaf506-aeea-444d-8053-05642ea4be31 service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received unexpected event network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 for instance with vm_state building and task_state spawning.
Aug 26 13:24:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:27 user nova-compute[73503]: INFO os_vif [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5')
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:24:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No VIF found with MAC fa:16:3e:cd:12:f8, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:28 user nova-compute[73503]: INFO nova.compute.manager [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Detaching volume 397201d5-ce48-4c81-8cac-9beebc512df0
Aug 26 13:24:28 user nova-compute[73503]: INFO nova.virt.block_device [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Attempting to driver detach volume 397201d5-ce48-4c81-8cac-9beebc512df0 from mountpoint /dev/vdb
Aug 26 13:24:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Attempting to detach device vdb from instance c7eb91d5-a544-464f-9bd5-26f579f05222 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:24:28 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:24:28 user nova-compute[73503]:   <source dev="/dev/sdg"/>
Aug 26 13:24:28 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:24:28 user nova-compute[73503]:   <serial>397201d5-ce48-4c81-8cac-9beebc512df0</serial>
Aug 26 13:24:28 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:24:28 user nova-compute[73503]: </disk>
Aug 26 13:24:28 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:24:28 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully detached device vdb from instance c7eb91d5-a544-464f-9bd5-26f579f05222 from the persistent domain config.
Aug 26 13:24:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7eb91d5-a544-464f-9bd5-26f579f05222 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:24:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:24:28 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:24:28 user nova-compute[73503]:   <source dev="/dev/sdg"/>
Aug 26 13:24:28 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:24:28 user nova-compute[73503]:   <serial>397201d5-ce48-4c81-8cac-9beebc512df0</serial>
Aug 26 13:24:28 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:24:28 user nova-compute[73503]: </disk>
Aug 26 13:24:28 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-b170d73a-b06d-4dfb-b495-1169f1aff555 req-cef370a8-0e72-4b03-9177-2c479411b0d3 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b170d73a-b06d-4dfb-b495-1169f1aff555 req-cef370a8-0e72-4b03-9177-2c479411b0d3 service nova] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b170d73a-b06d-4dfb-b495-1169f1aff555 req-cef370a8-0e72-4b03-9177-2c479411b0d3 service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b170d73a-b06d-4dfb-b495-1169f1aff555 req-cef370a8-0e72-4b03-9177-2c479411b0d3 service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-b170d73a-b06d-4dfb-b495-1169f1aff555 req-cef370a8-0e72-4b03-9177-2c479411b0d3 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] No waiting events found dispatching network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:29 user nova-compute[73503]: WARNING nova.compute.manager [req-b170d73a-b06d-4dfb-b495-1169f1aff555 req-cef370a8-0e72-4b03-9177-2c479411b0d3 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received unexpected event network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 for instance with vm_state building and task_state spawning.
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056269.4850981, c7eb91d5-a544-464f-9bd5-26f579f05222 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7eb91d5-a544-464f-9bd5-26f579f05222 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:24:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully detached device vdb from instance c7eb91d5-a544-464f-9bd5-26f579f05222 from the live domain config.
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIOiXUol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:24:29 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57811c-e1c4-418a-af5a-be1404f8ab28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f7b65-a6db-44a9-92d5-fa9e6a2935a9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:24:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 (non-flash)
Aug 26 13:24:29 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:24:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045c2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0'): ({'sdg'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Removing single pathed devices sdg {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbab59e-8c58-490d-a020-c6dcaf283f1c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.041s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c1e71d-2249-43f7-bec5-24f5fddb1a6a]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Flushing IO for device /dev/sdg {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55ae40-8f5a-4382-a231-c8e42186b619]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[314b9102-827e-42ad-92a8-aba88709b8ce]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] SCSI volumes sdg have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b863bf9d-97fd-44ac-bf52-12a79a403221]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b675249-bd40-4646-bfed-934370923cf7]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260]
Aug 26 13:24:29 user nova-compute[73503]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0, portal: 172.16.0.220,3260] successful.
Aug 26 13:24:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-3f67d6ac-5e95-45a9-9aaa-a3191f0e795f req-6289cc51-e571-4842-9dcc-c13c97053cad service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3f67d6ac-5e95-45a9-9aaa-a3191f0e795f req-6289cc51-e571-4842-9dcc-c13c97053cad service nova] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3f67d6ac-5e95-45a9-9aaa-a3191f0e795f req-6289cc51-e571-4842-9dcc-c13c97053cad service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3f67d6ac-5e95-45a9-9aaa-a3191f0e795f req-6289cc51-e571-4842-9dcc-c13c97053cad service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-3f67d6ac-5e95-45a9-9aaa-a3191f0e795f req-6289cc51-e571-4842-9dcc-c13c97053cad service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] No waiting events found dispatching network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:29 user nova-compute[73503]: WARNING nova.compute.manager [req-3f67d6ac-5e95-45a9-9aaa-a3191f0e795f req-6289cc51-e571-4842-9dcc-c13c97053cad service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received unexpected event network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 for instance with vm_state building and task_state spawning.
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:397201d5-ce48-4c81-8cac-9beebc512df0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[577b3da6-cbf2-47e1-ba0f-8178d36be34b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] <== disconnect_volume: return (358ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056270.0273342, 9c247e08-3242-4197-9266-15ebf49a7397 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] VM Resumed (Lifecycle Event)
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Instance spawned successfully.
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056270.033997, 9c247e08-3242-4197-9266-15ebf49a7397 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] VM Started (Lifecycle Event)
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:30 user nova-compute[73503]: INFO nova.compute.manager [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Took 7.91 seconds to build instance.
Aug 26 13:24:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6643945d-84d6-4b0f-bdf2-dab79fd1f07b tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "9c247e08-3242-4197-9266-15ebf49a7397" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.024s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG nova.objects.instance [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'flavor' on Instance uuid c7eb91d5-a544-464f-9bd5-26f579f05222 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7234191f-b17f-44d5-bf72-4ccc777ae408 tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.309s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-a63ce6b6-b86b-4ef9-a7b5-763be01d9608 req-c0036885-0c2c-4030-90a5-a673013dd0ab service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a63ce6b6-b86b-4ef9-a7b5-763be01d9608 req-c0036885-0c2c-4030-90a5-a673013dd0ab service nova] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a63ce6b6-b86b-4ef9-a7b5-763be01d9608 req-c0036885-0c2c-4030-90a5-a673013dd0ab service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a63ce6b6-b86b-4ef9-a7b5-763be01d9608 req-c0036885-0c2c-4030-90a5-a673013dd0ab service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-a63ce6b6-b86b-4ef9-a7b5-763be01d9608 req-c0036885-0c2c-4030-90a5-a673013dd0ab service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] No waiting events found dispatching network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:31 user nova-compute[73503]: WARNING nova.compute.manager [req-a63ce6b6-b86b-4ef9-a7b5-763be01d9608 req-c0036885-0c2c-4030-90a5-a673013dd0ab service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received unexpected event network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 for instance with vm_state building and task_state spawning.
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056271.71913, d13159b8-3de6-4480-9762-df9c558096f3 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] VM Resumed (Lifecycle Event)
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Instance spawned successfully.
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056271.7225416, d13159b8-3de6-4480-9762-df9c558096f3 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] VM Started (Lifecycle Event)
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 26 13:24:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:31 user nova-compute[73503]: INFO nova.compute.manager [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Took 26.03 seconds to build instance.
Aug 26 13:24:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7c515542-8753-4584-938f-dcf02e188fc7 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "d13159b8-3de6-4480-9762-df9c558096f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.195s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:24:42 user nova-compute[73503]: INFO nova.compute.claims [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Claim successful on node user
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:24:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.policy [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad99f2e83e814a07a9f41d00b6bcecde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b92392a06d1e41d49af47410121fabc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:24:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Creating image(s)
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.218s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk 1073741824" returned: 0 in 0.057s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Successfully created port: 038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Cannot resize image /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Successfully updated port: 038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing instance network info cache due to event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance network_info: |[{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Start _get_guest_xml network_info=[{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:24:44 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:44 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523018557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523018557',id=30,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsm5frv1VuuEfrbMMQ549CCXk5wbnIAmA0b4+c+RMyqih7oGJ2x7c2afjSVPKpVDBQ0dvlOa4mu4u7bqWODprP5bQg56UELrAGvuBzB0WlZ0anIC45pthw7Asz8KRdnQ==',key_name='tempest-keypair-1858926900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-9bgjnz2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:24:44 user nova-compute[73503]:   <uuid>9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02</uuid>
Aug 26 13:24:44 user nova-compute[73503]:   <name>instance-0000001e</name>
Aug 26 13:24:44 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:24:44 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:24:44 user nova-compute[73503]:   <metadata>
Aug 26 13:24:44 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:24:44 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:24:44 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-523018557</nova:name>
Aug 26 13:24:44 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:24:44</nova:creationTime>
Aug 26 13:24:44 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:24:44 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:24:44 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:24:44 user nova-compute[73503]:       <nova:owner>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:user uuid="ad99f2e83e814a07a9f41d00b6bcecde">tempest-AttachVolumeShelveTestJSON-568979141-project-member</nova:user>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:project uuid="b92392a06d1e41d49af47410121fabc0">tempest-AttachVolumeShelveTestJSON-568979141</nova:project>
Aug 26 13:24:44 user nova-compute[73503]:       </nova:owner>
Aug 26 13:24:44 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:24:44 user nova-compute[73503]:       <nova:ports>
Aug 26 13:24:44 user nova-compute[73503]:         <nova:port uuid="038813f4-35c2-4b75-9de1-f2bc3df33fe0">
Aug 26 13:24:44 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:24:44 user nova-compute[73503]:         </nova:port>
Aug 26 13:24:44 user nova-compute[73503]:       </nova:ports>
Aug 26 13:24:44 user nova-compute[73503]:     </nova:instance>
Aug 26 13:24:44 user nova-compute[73503]:   </metadata>
Aug 26 13:24:44 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:24:44 user nova-compute[73503]:     <system>
Aug 26 13:24:44 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:24:44 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:24:44 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:24:44 user nova-compute[73503]:       <entry name="serial">9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02</entry>
Aug 26 13:24:44 user nova-compute[73503]:       <entry name="uuid">9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02</entry>
Aug 26 13:24:44 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:24:44 user nova-compute[73503]:     </system>
Aug 26 13:24:44 user nova-compute[73503]:   </sysinfo>
Aug 26 13:24:44 user nova-compute[73503]:   <os>
Aug 26 13:24:44 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:24:44 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:24:44 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:24:44 user nova-compute[73503]:   </os>
Aug 26 13:24:44 user nova-compute[73503]:   <features>
Aug 26 13:24:44 user nova-compute[73503]:     <acpi/>
Aug 26 13:24:44 user nova-compute[73503]:     <apic/>
Aug 26 13:24:44 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:24:44 user nova-compute[73503]:   </features>
Aug 26 13:24:44 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:24:44 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:24:44 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:24:44 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:24:44 user nova-compute[73503]:   </clock>
Aug 26 13:24:44 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:24:44 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:24:44 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:24:44 user nova-compute[73503]:   </cpu>
Aug 26 13:24:44 user nova-compute[73503]:   <devices>
Aug 26 13:24:44 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:24:44 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:24:44 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk"/>
Aug 26 13:24:44 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:24:44 user nova-compute[73503]:     </disk>
Aug 26 13:24:44 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:24:44 user nova-compute[73503]:       <mac address="fa:16:3e:77:6d:4b"/>
Aug 26 13:24:44 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:44 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:24:44 user nova-compute[73503]:       <target dev="tap038813f4-35"/>
Aug 26 13:24:44 user nova-compute[73503]:     </interface>
Aug 26 13:24:44 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:24:44 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/console.log" append="off"/>
Aug 26 13:24:44 user nova-compute[73503]:     </serial>
Aug 26 13:24:44 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:24:44 user nova-compute[73503]:     <video>
Aug 26 13:24:44 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:24:44 user nova-compute[73503]:     </video>
Aug 26 13:24:44 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:24:44 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:24:44 user nova-compute[73503]:     </rng>
Aug 26 13:24:44 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:24:44 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:24:44 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:24:44 user nova-compute[73503]:     </memballoon>
Aug 26 13:24:44 user nova-compute[73503]:   </devices>
Aug 26 13:24:44 user nova-compute[73503]: </domain>
Aug 26 13:24:44 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523018557',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523018557',id=30,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsm5frv1VuuEfrbMMQ549CCXk5wbnIAmA0b4+c+RMyqih7oGJ2x7c2afjSVPKpVDBQ0dvlOa4mu4u7bqWODprP5bQg56UELrAGvuBzB0WlZ0anIC45pthw7Asz8KRdnQ==',key_name='tempest-keypair-1858926900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-9bgjnz2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:24:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG os_vif [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038813f4-35, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap038813f4-35, col_values=(('external_ids', {'iface-id': '038813f4-35c2-4b75-9de1-f2bc3df33fe0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:6d:4b', 'vm-uuid': '9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:44 user nova-compute[73503]: INFO os_vif [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35')
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:24:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No VIF found with MAC fa:16:3e:77:6d:4b, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:24:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updated VIF entry in instance network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:24:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:24:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f15179f5-78e9-42cb-a89a-bc02e256b69f req-b4a99a24-677c-49cd-862c-6ffd65523d75 service nova] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-67585f80-f00c-41d2-bc10-7c036d3f389d req-a7f22557-3ff7-4011-a722-159670cbc686 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-67585f80-f00c-41d2-bc10-7c036d3f389d req-a7f22557-3ff7-4011-a722-159670cbc686 service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-67585f80-f00c-41d2-bc10-7c036d3f389d req-a7f22557-3ff7-4011-a722-159670cbc686 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-67585f80-f00c-41d2-bc10-7c036d3f389d req-a7f22557-3ff7-4011-a722-159670cbc686 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-67585f80-f00c-41d2-bc10-7c036d3f389d req-a7f22557-3ff7-4011-a722-159670cbc686 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:46 user nova-compute[73503]: WARNING nova.compute.manager [req-67585f80-f00c-41d2-bc10-7c036d3f389d req-a7f22557-3ff7-4011-a722-159670cbc686 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state building and task_state spawning.
Aug 26 13:24:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-1393846c-e660-4527-8917-38970b848c49 req-5b85b0f1-542c-4c8a-a238-ff604f3a7094 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1393846c-e660-4527-8917-38970b848c49 req-5b85b0f1-542c-4c8a-a238-ff604f3a7094 service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1393846c-e660-4527-8917-38970b848c49 req-5b85b0f1-542c-4c8a-a238-ff604f3a7094 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1393846c-e660-4527-8917-38970b848c49 req-5b85b0f1-542c-4c8a-a238-ff604f3a7094 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-1393846c-e660-4527-8917-38970b848c49 req-5b85b0f1-542c-4c8a-a238-ff604f3a7094 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:24:48 user nova-compute[73503]: WARNING nova.compute.manager [req-1393846c-e660-4527-8917-38970b848c49 req-5b85b0f1-542c-4c8a-a238-ff604f3a7094 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state building and task_state spawning.
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056288.9347627, 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:48 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] VM Resumed (Lifecycle Event)
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:24:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance spawned successfully.
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:24:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:49 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056288.9381933, 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:24:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] VM Started (Lifecycle Event)
Aug 26 13:24:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:24:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:24:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Took 6.23 seconds to spawn the instance on the hypervisor.
Aug 26 13:24:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:24:49 user nova-compute[73503]: INFO nova.compute.manager [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Took 7.15 seconds to build instance.
Aug 26 13:24:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b9ae3d79-8cc6-4c1f-a3e3-5dfcad80b4d7 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.250s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:24:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:24:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-changed-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Refreshing instance network info cache due to event network-changed-8b2435b5-a0f6-40b5-819e-7fb2630cb39e. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:25:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:01 user nova-compute[73503]: DEBUG nova.network.neutron [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Refreshing network info cache for port 8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:25:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updated VIF entry in instance network info cache for port 8b2435b5-a0f6-40b5-819e-7fb2630cb39e. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:25:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef9d6684-7954-4504-9eec-8ecff724d3aa req-94e780ae-7500-4f64-9e97-a0a1c8a81fb3 service nova] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-changed-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Refreshing instance network info cache due to event network-changed-3d573016-adf7-4853-ae4e-12bc20032ad2. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] Acquiring lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] Acquired lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Refreshing network info cache for port 3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updated VIF entry in instance network info cache for port 3d573016-adf7-4853-ae4e-12bc20032ad2. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02567903-1591-4c2d-befe-a232106552fa req-94b0d3d7-17f5-4587-ae42-c63b2459eddd service nova] Releasing lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Stashing vm_state: active {{(pid=73503) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:25:04 user nova-compute[73503]: INFO nova.compute.claims [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Claim successful on node user
Aug 26 13:25:04 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating resource usage from migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c
Aug 26 13:25:04 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.664s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:04 user nova-compute[73503]: INFO nova.compute.manager [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Migrating
Aug 26 13:25:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquired lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG nova.network.neutron [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:25:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG nova.network.neutron [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Releasing lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Starting migrate_disk_and_power_off {{(pid=73503) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-32557174-875b-435c-a384-d0119f0e670f req-d6d1cf1e-d5f0-427c-81c8-105f74e83710 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-unplugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-32557174-875b-435c-a384-d0119f0e670f req-d6d1cf1e-d5f0-427c-81c8-105f74e83710 service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-32557174-875b-435c-a384-d0119f0e670f req-d6d1cf1e-d5f0-427c-81c8-105f74e83710 service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-32557174-875b-435c-a384-d0119f0e670f req-d6d1cf1e-d5f0-427c-81c8-105f74e83710 service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-32557174-875b-435c-a384-d0119f0e670f req-d6d1cf1e-d5f0-427c-81c8-105f74e83710 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-unplugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:05 user nova-compute[73503]: WARNING nova.compute.manager [req-32557174-875b-435c-a384-d0119f0e670f req-d6d1cf1e-d5f0-427c-81c8-105f74e83710 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-unplugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state active and task_state resize_migrating.
Aug 26 13:25:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance destroyed successfully.
Aug 26 13:25:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2107938244',display_name='tempest-ServerActionsTestOtherA-server-2107938244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2107938244',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-dfmxnzuv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:25:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ac1098c8-c3d6-4f13-9093-3a4100e41299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d573016-ad, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:06 user nova-compute[73503]: INFO os_vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad')
Aug 26 13:25:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:06 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a0b5b-c6e3-4054-8786-b5245c60b662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a0da9a-70f8-4535-9fec-a55132e44dd8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:06 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31437d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b687f2-c161-4920-8079-b9198aabbcc0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4aae43-ce17-4a8d-aad6-5d61a3d6ea04]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5b9d2-ee44-4321-88cc-b4dc83f854ec]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459a2b7-0baf-4ed6-872d-dcd9ed1872e6]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23066623766646663', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7c167f61', '/dev/disk/by-id/scsi-1SCST_BIO7c167f61-0fb7fdfc6cda6eb3') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d18b21-0072-4192-9d16-9be301e54781]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[779b66e3-a349-4a59-bbe4-8c0cd7c809c3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf29bdc-35d6-4fda-96b3-79335014a39f]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]
Aug 26 13:25:06 user nova-compute[73503]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.
Aug 26 13:25:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae37189-224c-4c55-9bc8-e28a926ad1f6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== disconnect_volume: return (335ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:25:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Port 3d573016-adf7-4853-ae4e-12bc20032ad2 binding to destination host user is already ACTIVE {{(pid=73503) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquired lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ad95e78-a98a-42ee-bcd3-c9445dd94a93 req-4db97595-ec20-4e48-a4fd-a4d18b7dbdd4 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ad95e78-a98a-42ee-bcd3-c9445dd94a93 req-4db97595-ec20-4e48-a4fd-a4d18b7dbdd4 service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ad95e78-a98a-42ee-bcd3-c9445dd94a93 req-4db97595-ec20-4e48-a4fd-a4d18b7dbdd4 service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6ad95e78-a98a-42ee-bcd3-c9445dd94a93 req-4db97595-ec20-4e48-a4fd-a4d18b7dbdd4 service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-6ad95e78-a98a-42ee-bcd3-c9445dd94a93 req-4db97595-ec20-4e48-a4fd-a4d18b7dbdd4 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:07 user nova-compute[73503]: WARNING nova.compute.manager [req-6ad95e78-a98a-42ee-bcd3-c9445dd94a93 req-4db97595-ec20-4e48-a4fd-a4d18b7dbdd4 service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state active and task_state resize_migrated.
Aug 26 13:25:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Releasing lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG os_brick.utils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c18dbf-ce3d-4349-b708-12b0796259e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a4a08e-b50c-44a5-9dcf-5ec2ff06cf8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fecad4-c219-479c-b64f-2395858bae42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc2202-6e43-4425-94d9-82a6a84e33cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:25:08 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:25:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb9b4e-e70a-4d87-a7e2-7b9cae20c64d]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:25:08 user nova-compute[73503]: DEBUG os_brick.utils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:10 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:25:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquired lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'info_cache' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating instance_info_cache with network_info: [{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Releasing lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:18 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance destroyed successfully.
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'resources' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d4a2ae9-81, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:18 user nova-compute[73503]: INFO os_vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81')
Aug 26 13:25:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:18 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3ade92-dc7b-466a-90c1-8ff3fdfc01ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03a4a59-811e-45fe-b069-fc4d42221a95]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:18 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31c0b1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c79550a-a3c5-4569-b167-2081ddbe11f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a11207-92e3-4c83-9d4b-dc9d112f6a63]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6963aafb-d912-4d83-8d8d-0143002808b8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb6bba-2f33-4731-8c6d-2614dd3b1063]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a2df8-93c6-4ea3-a4b0-4af8c2188346]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[db844405-8ff1-4a3f-b538-fc41340996cc]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]
Aug 26 13:25:19 user nova-compute[73503]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bf6821-6593-456a-ab4f-d77abec7c021]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== disconnect_volume: return (367ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start _get_guest_xml network_info=[{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'da1fecf0-ecdf-4e5a-91c5-b83676d953ec', 'attached_at': '', 'detached_at': '', 'volume_id': '06b2c1b8-db21-46ba-8979-b57ff7535691', 'serial': '06b2c1b8-db21-46ba-8979-b57ff7535691'}, 'attachment_id': 'dc3a53e7-0c24-4803-80a7-bb3f9bc8f8d9', 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'numa_topology' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:19 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:25:19 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'vcpu_model' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:19 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:19 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:19 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad1969a-fcaa-4d8b-bbfb-2a59ec987dec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:25:19 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-changed-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Refreshing instance network info cache due to event network-changed-7e469415-9c9e-4677-9fc2-aef5ee3b0aed. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] Acquiring lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] Acquired lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.network.neutron [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Refreshing network info cache for port 7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5700c1bd-f022-4cba-8f3d-9bb7d2cb1cca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691] added
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[29896036-7a4c-47ca-a7f3-d04fb32adf57]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f2dcb-a0c4-4c75-b8e5-fe3e5a97c337]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmUyJTdS {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:19 user nova-compute[73503]: INFO nova.compute.manager [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Terminating instance
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmUyJTdS" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8a495a-d65a-404f-ada8-0321d35a8b7b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmUyJTdS'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc45502-31fe-4e20-a10f-236da33d707c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ff51ec-16ef-433d-a82d-3f4dc1fa0289]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[655435d1-8376-4a86-93ef-15bfaa5da2ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]
Aug 26 13:25:19 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ca8d2-6c20-4b22-b206-2186818b9df8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad81694-e5a4-43e3-8388-6a04efead43a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:19 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:19 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca990ac-8479-4c4a-be5f-bae15d3996f0]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8cc3abb-7c8f-4d85-99e9-9eeb89aa1ee0 req-0763b561-2cea-4156-a408-22f9c0dea362 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-vif-unplugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8cc3abb-7c8f-4d85-99e9-9eeb89aa1ee0 req-0763b561-2cea-4156-a408-22f9c0dea362 service nova] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8cc3abb-7c8f-4d85-99e9-9eeb89aa1ee0 req-0763b561-2cea-4156-a408-22f9c0dea362 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8cc3abb-7c8f-4d85-99e9-9eeb89aa1ee0 req-0763b561-2cea-4156-a408-22f9c0dea362 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8cc3abb-7c8f-4d85-99e9-9eeb89aa1ee0 req-0763b561-2cea-4156-a408-22f9c0dea362 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] No waiting events found dispatching network-vif-unplugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8cc3abb-7c8f-4d85-99e9-9eeb89aa1ee0 req-0763b561-2cea-4156-a408-22f9c0dea362 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-vif-unplugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.neutron [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updated VIF entry in instance network info cache for port 7e469415-9c9e-4677-9fc2-aef5ee3b0aed. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.neutron [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updating instance_info_cache with network_info: [{"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ccffeb38-550d-47b5-a242-aff8ab880f15 req-3fe2e733-3ebb-4fd2-a722-5fcf06c17c1c service nova] Releasing lock "refresh_cache-c7eb91d5-a544-464f-9bd5-26f579f05222" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Instance destroyed successfully.
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.objects.instance [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'resources' on Instance uuid c7eb91d5-a544-464f-9bd5-26f579f05222 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1117575148',display_name='tempest-TestStampPattern-server-1117575148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1117575148',id=25,image_ref='a3dfe2a6-48db-4e42-afdd-013b1feade2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn2+pFLZ2VSZx7AckabSo562zlp19RUMBiOGyV73023vTl3GUKSePV72rfCWrRK/uBW0wHSSndFaIZ2aHgqtusbD669E0l1ESLIroNlZsjUuKyclKN2VYcnFWYA9yluhg==',key_name='tempest-TestStampPattern-764130994',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4179d75d5a49ffa8caae46f900f993',ramdisk_id='',reservation_id='r-trcrfjm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6fb3f5db-a603-4982-8304-c4601a5c5b17',image_min_disk='1',image_min_ram='0',image_owner_id='af4179d75d5a49ffa8caae46f900f993',image_owner_project_name='tempest-TestStampPattern-585487806',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-585487806-project-member',image_user_id='a8afe79d50d64cc3b087d5ecaacc66cb',owner_project_name='tempest-TestStampPattern-585487806',owner_user_name='tempest-TestStampPattern-585487806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:22:24Z,user_data=None,user_id='a8afe79d50d64cc3b087d5ecaacc66cb',uuid=c7eb91d5-a544-464f-9bd5-26f579f05222,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converting VIF {"id": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "address": "fa:16:3e:94:90:9c", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e469415-9c", "ovs_interfaceid": "7e469415-9c9e-4677-9fc2-aef5ee3b0aed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG os_vif [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e469415-9c, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:25:20 user nova-compute[73503]: INFO os_vif [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:90:9c,bridge_name='br-int',has_traffic_filtering=True,id=7e469415-9c9e-4677-9fc2-aef5ee3b0aed,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e469415-9c')
Aug 26 13:25:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Deleting instance files /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222_del
Aug 26 13:25:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Deletion of /opt/stack/data/nova/instances/c7eb91d5-a544-464f-9bd5-26f579f05222_del complete
Aug 26 13:25:20 user nova-compute[73503]: INFO nova.compute.manager [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '26531343361356161', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531343361356161', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'pci_devices' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:25:20 user nova-compute[73503]:   <uuid>da1fecf0-ecdf-4e5a-91c5-b83676d953ec</uuid>
Aug 26 13:25:20 user nova-compute[73503]:   <name>instance-00000017</name>
Aug 26 13:25:20 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:25:20 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:25:20 user nova-compute[73503]:   <metadata>
Aug 26 13:25:20 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:25:20 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:25:20 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeTestJSON-server-236484995</nova:name>
Aug 26 13:25:20 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:25:19</nova:creationTime>
Aug 26 13:25:20 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:25:20 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:25:20 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:25:20 user nova-compute[73503]:       <nova:owner>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:user uuid="ad6390e5b4c64754ab6f14217f4da833">tempest-AttachVolumeTestJSON-1183738962-project-member</nova:user>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:project uuid="2c8314eb6dec444ea31e9685d11b2fac">tempest-AttachVolumeTestJSON-1183738962</nova:project>
Aug 26 13:25:20 user nova-compute[73503]:       </nova:owner>
Aug 26 13:25:20 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:25:20 user nova-compute[73503]:       <nova:ports>
Aug 26 13:25:20 user nova-compute[73503]:         <nova:port uuid="8d4a2ae9-81c6-46c2-b949-749cb1976f32">
Aug 26 13:25:20 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:25:20 user nova-compute[73503]:         </nova:port>
Aug 26 13:25:20 user nova-compute[73503]:       </nova:ports>
Aug 26 13:25:20 user nova-compute[73503]:     </nova:instance>
Aug 26 13:25:20 user nova-compute[73503]:   </metadata>
Aug 26 13:25:20 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:25:20 user nova-compute[73503]:     <system>
Aug 26 13:25:20 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:25:20 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:25:20 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:25:20 user nova-compute[73503]:       <entry name="serial">da1fecf0-ecdf-4e5a-91c5-b83676d953ec</entry>
Aug 26 13:25:20 user nova-compute[73503]:       <entry name="uuid">da1fecf0-ecdf-4e5a-91c5-b83676d953ec</entry>
Aug 26 13:25:20 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:25:20 user nova-compute[73503]:     </system>
Aug 26 13:25:20 user nova-compute[73503]:   </sysinfo>
Aug 26 13:25:20 user nova-compute[73503]:   <os>
Aug 26 13:25:20 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:25:20 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:25:20 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:25:20 user nova-compute[73503]:   </os>
Aug 26 13:25:20 user nova-compute[73503]:   <features>
Aug 26 13:25:20 user nova-compute[73503]:     <acpi/>
Aug 26 13:25:20 user nova-compute[73503]:     <apic/>
Aug 26 13:25:20 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:25:20 user nova-compute[73503]:   </features>
Aug 26 13:25:20 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:25:20 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:25:20 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:25:20 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:25:20 user nova-compute[73503]:   </clock>
Aug 26 13:25:20 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:25:20 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:25:20 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:25:20 user nova-compute[73503]:   </cpu>
Aug 26 13:25:20 user nova-compute[73503]:   <devices>
Aug 26 13:25:20 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:25:20 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:25:20 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk"/>
Aug 26 13:25:20 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:25:20 user nova-compute[73503]:     </disk>
Aug 26 13:25:20 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:25:20 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:25:20 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:25:20 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:25:20 user nova-compute[73503]:       <serial>06b2c1b8-db21-46ba-8979-b57ff7535691</serial>
Aug 26 13:25:20 user nova-compute[73503]:     </disk>
Aug 26 13:25:20 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:25:20 user nova-compute[73503]:       <mac address="fa:16:3e:89:cd:85"/>
Aug 26 13:25:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:25:20 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:25:20 user nova-compute[73503]:       <target dev="tap8d4a2ae9-81"/>
Aug 26 13:25:20 user nova-compute[73503]:     </interface>
Aug 26 13:25:20 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:25:20 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/console.log" append="off"/>
Aug 26 13:25:20 user nova-compute[73503]:     </serial>
Aug 26 13:25:20 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:25:20 user nova-compute[73503]:     <video>
Aug 26 13:25:20 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:25:20 user nova-compute[73503]:     </video>
Aug 26 13:25:20 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:25:20 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:25:20 user nova-compute[73503]:     </rng>
Aug 26 13:25:20 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:25:20 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:25:20 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:25:20 user nova-compute[73503]:     </memballoon>
Aug 26 13:25:20 user nova-compute[73503]:   </devices>
Aug 26 13:25:20 user nova-compute[73503]: </domain>
Aug 26 13:25:20 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:25:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Took 0.65 seconds to deallocate network for instance.
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Starting finish_migration {{(pid=73503) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:25:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Creating image(s)
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Ensure instance console log exists: /opt/stack/data/nova/instances/ac1098c8-c3d6-4f13-9093-3a4100e41299/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Start _get_guest_xml network_info=[{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ac1098c8-c3d6-4f13-9093-3a4100e41299', 'attached_at': '2023-08-26T13:25:21.000000', 'detached_at': '', 'volume_id': '60538b82-2d4f-4943-ac10-8b7a8ace56cd', 'serial': '60538b82-2d4f-4943-ac10-8b7a8ace56cd'}, 'attachment_id': '69348fda-0d3c-4211-b225-a64ebd255ca8', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056306.2701745, ac1098c8-c3d6-4f13-9093-3a4100e41299 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:25:21 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] VM Stopped (Lifecycle Event)
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6a4f0681-d739-4b38-8402-6b748b54b7a2 None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'trusted_certs' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6a4f0681-d739-4b38-8402-6b748b54b7a2 None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:25:21 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:25:21 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: INFO nova.compute.manager [None req-6a4f0681-d739-4b38-8402-6b748b54b7a2 None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:21 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c209886-dfd1-4cde-b44e-76108f1c8dae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:25:21 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d7bf0-7327-446d-b47e-8d4e57a67285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd] added
Aug 26 13:25:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fced1f-5c7b-406d-bacb-177f80ab595d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.244s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9815e5-fc10-439f-8632-bd4a1006787e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuhMmAsW {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuhMmAsW" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb046ba-91a4-4d49-9195-e11559b4d239]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FuhMmAsW'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5933a73-0c03-4a88-acc3-5dfc60e8bce8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Cannot resize image /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'migration_context' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c2427d-c395-4ed8-b8b9-293fd93a28db]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.objects.base [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d4a2ae9-81, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d4a2ae9-81, col_values=(('external_ids', {'iface-id': '8d4a2ae9-81c6-46c2-b949-749cb1976f32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:cd:85', 'vm-uuid': 'da1fecf0-ecdf-4e5a-91c5-b83676d953ec'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:21 user nova-compute[73503]: INFO os_vif [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81')
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0a3a1a-3f8a-4fd3-88c0-f9a66b9fa288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]
Aug 26 13:25:21 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.
Aug 26 13:25:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ec044-443d-4d38-b161-39cfcf3316df]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a214240-d78f-4275-b451-c9880f232e95]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:21 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:25:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f50a85-b062-4162-932f-d25d03b41fe8]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.844s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] Acquiring lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] No waiting events found dispatching network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:22 user nova-compute[73503]: WARNING nova.compute.manager [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received unexpected event network-vif-plugged-7e469415-9c9e-4677-9fc2-aef5ee3b0aed for instance with vm_state deleted and task_state None.
Aug 26 13:25:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-5ed9895e-803d-4a7a-a636-ad8948296332 req-0ca5c983-5d2d-42a9-a8a3-c5e0a6365759 service nova] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Received event network-vif-deleted-7e469415-9c9e-4677-9fc2-aef5ee3b0aed {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:22 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Deleted allocations for instance c7eb91d5-a544-464f-9bd5-26f579f05222
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b0ac24-a2e2-40e3-9d91-93f07a802d3d tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "c7eb91d5-a544-464f-9bd5-26f579f05222" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.790s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== connect_volume: return (1546ms) {'type': 'block', 'scsi_wwn': '23066623766646663', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623766646663', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2107938244',display_name='tempest-ServerActionsTestOtherA-server-2107938244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2107938244',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-dfmxnzuv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ac1098c8-c3d6-4f13-9093-3a4100e41299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:25:23 user nova-compute[73503]:   <uuid>ac1098c8-c3d6-4f13-9093-3a4100e41299</uuid>
Aug 26 13:25:23 user nova-compute[73503]:   <name>instance-0000001a</name>
Aug 26 13:25:23 user nova-compute[73503]:   <memory>2097152</memory>
Aug 26 13:25:23 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:25:23 user nova-compute[73503]:   <metadata>
Aug 26 13:25:23 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:25:23 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:25:23 user nova-compute[73503]:       <nova:name>tempest-ServerActionsTestOtherA-server-2107938244</nova:name>
Aug 26 13:25:23 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:25:21</nova:creationTime>
Aug 26 13:25:23 user nova-compute[73503]:       <nova:flavor name="m1.small">
Aug 26 13:25:23 user nova-compute[73503]:         <nova:memory>2048</nova:memory>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:disk>20</nova:disk>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:25:23 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:25:23 user nova-compute[73503]:       <nova:owner>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:user uuid="2a9851519cfc49c388894f0884261586">tempest-ServerActionsTestOtherA-856596274-project-member</nova:user>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:project uuid="9f8967f8280045e8b45d9298bda30914">tempest-ServerActionsTestOtherA-856596274</nova:project>
Aug 26 13:25:23 user nova-compute[73503]:       </nova:owner>
Aug 26 13:25:23 user nova-compute[73503]:       <nova:ports>
Aug 26 13:25:23 user nova-compute[73503]:         <nova:port uuid="3d573016-adf7-4853-ae4e-12bc20032ad2">
Aug 26 13:25:23 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 13:25:23 user nova-compute[73503]:         </nova:port>
Aug 26 13:25:23 user nova-compute[73503]:       </nova:ports>
Aug 26 13:25:23 user nova-compute[73503]:     </nova:instance>
Aug 26 13:25:23 user nova-compute[73503]:   </metadata>
Aug 26 13:25:23 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:25:23 user nova-compute[73503]:     <system>
Aug 26 13:25:23 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:25:23 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:25:23 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:25:23 user nova-compute[73503]:       <entry name="serial">ac1098c8-c3d6-4f13-9093-3a4100e41299</entry>
Aug 26 13:25:23 user nova-compute[73503]:       <entry name="uuid">ac1098c8-c3d6-4f13-9093-3a4100e41299</entry>
Aug 26 13:25:23 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:25:23 user nova-compute[73503]:     </system>
Aug 26 13:25:23 user nova-compute[73503]:   </sysinfo>
Aug 26 13:25:23 user nova-compute[73503]:   <os>
Aug 26 13:25:23 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:25:23 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:25:23 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:25:23 user nova-compute[73503]:   </os>
Aug 26 13:25:23 user nova-compute[73503]:   <features>
Aug 26 13:25:23 user nova-compute[73503]:     <acpi/>
Aug 26 13:25:23 user nova-compute[73503]:     <apic/>
Aug 26 13:25:23 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:25:23 user nova-compute[73503]:   </features>
Aug 26 13:25:23 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:25:23 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:25:23 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:25:23 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:25:23 user nova-compute[73503]:   </clock>
Aug 26 13:25:23 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:25:23 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:25:23 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:25:23 user nova-compute[73503]:   </cpu>
Aug 26 13:25:23 user nova-compute[73503]:   <devices>
Aug 26 13:25:23 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:25:23 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:25:23 user nova-compute[73503]:       <source dev="/dev/sde"/>
Aug 26 13:25:23 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:25:23 user nova-compute[73503]:       <serial>60538b82-2d4f-4943-ac10-8b7a8ace56cd</serial>
Aug 26 13:25:23 user nova-compute[73503]:     </disk>
Aug 26 13:25:23 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:25:23 user nova-compute[73503]:       <mac address="fa:16:3e:5d:bf:6d"/>
Aug 26 13:25:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:25:23 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:25:23 user nova-compute[73503]:       <target dev="tap3d573016-ad"/>
Aug 26 13:25:23 user nova-compute[73503]:     </interface>
Aug 26 13:25:23 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:25:23 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/ac1098c8-c3d6-4f13-9093-3a4100e41299/console.log" append="off"/>
Aug 26 13:25:23 user nova-compute[73503]:     </serial>
Aug 26 13:25:23 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:25:23 user nova-compute[73503]:     <video>
Aug 26 13:25:23 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:25:23 user nova-compute[73503]:     </video>
Aug 26 13:25:23 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:25:23 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:25:23 user nova-compute[73503]:     </rng>
Aug 26 13:25:23 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:25:23 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:25:23 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:25:23 user nova-compute[73503]:     </memballoon>
Aug 26 13:25:23 user nova-compute[73503]:   </devices>
Aug 26 13:25:23 user nova-compute[73503]: </domain>
Aug 26 13:25:23 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2107938244',display_name='tempest-ServerActionsTestOtherA-server-2107938244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2107938244',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-dfmxnzuv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ac1098c8-c3d6-4f13-9093-3a4100e41299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-348791271-network", "vif_mac": "fa:16:3e:5d:bf:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG os_vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d573016-ad, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d573016-ad, col_values=(('external_ids', {'iface-id': '3d573016-adf7-4853-ae4e-12bc20032ad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:bf:6d', 'vm-uuid': 'ac1098c8-c3d6-4f13-9093-3a4100e41299'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: INFO os_vif [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad')
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] No VIF found with MAC fa:16:3e:5d:bf:6d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:23 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Error from libvirt while getting description of instance-00000019: [Error Code 42] Domain not found: no domain with matching uuid 'c7eb91d5-a544-464f-9bd5-26f579f05222' (instance-00000019): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c7eb91d5-a544-464f-9bd5-26f579f05222' (instance-00000019)
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:24 user nova-compute[73503]: WARNING nova.compute.manager [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state powering-on.
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:24 user nova-compute[73503]: WARNING nova.compute.manager [req-418657a1-d46a-4f06-bf55-c7a956404e58 req-9982d3b6-6b5f-4b26-a4d4-8e0a8997d46a service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state powering-on.
Aug 26 13:25:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:25:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=6848MB free_disk=24.88119125366211GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Applying migration context for instance ac1098c8-c3d6-4f13-9093-3a4100e41299 as it has an incoming, in-progress migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c. Migration status is post-migrating {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 13:25:24 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating resource usage from migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c
Aug 26 13:25:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9c247e08-3242-4197-9266-15ebf49a7397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2532b05a-30b5-4516-b701-6fbc71e74352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 90c4814c-43f2-454f-964b-6179892193c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d13159b8-3de6-4480-9762-df9c558096f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:25 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:25:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:25:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:25:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.786s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:26 user nova-compute[73503]: WARNING nova.compute.manager [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state active and task_state resize_finish.
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:26 user nova-compute[73503]: WARNING nova.compute.manager [req-e061c859-da31-460b-a545-eeeb23b3ef39 req-b3784844-eae9-4267-82d8-f7b796e6f5cc service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state active and task_state resize_finish.
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056326.755243, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:25:26 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Resumed (Lifecycle Event)
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:25:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance rebooted successfully.
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9785c499-4057-4ff7-9deb-570350f025ce tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:25:26 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056326.7566779, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:25:26 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Started (Lifecycle Event)
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056327.0809948, ac1098c8-c3d6-4f13-9093-3a4100e41299 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:25:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] VM Resumed (Lifecycle Event)
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:25:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance running successfully.
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Failed to set time: agent not configured {{(pid=73503) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-43fcc2e2-3906-4727-819d-a1be44a49250 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] finish_migration finished successfully. {{(pid=73503) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:25:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056327.0823584, ac1098c8-c3d6-4f13-9093-3a4100e41299 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:25:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] VM Started (Lifecycle Event)
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:25:27 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 13:25:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:25:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing instance network info cache due to event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:25:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:32 user nova-compute[73503]: INFO nova.compute.manager [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Detaching volume 80a37ad7-c57d-42dc-9d55-fdb1a58305cb
Aug 26 13:25:32 user nova-compute[73503]: INFO nova.virt.block_device [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Attempting to driver detach volume 80a37ad7-c57d-42dc-9d55-fdb1a58305cb from mountpoint /dev/vdb
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Attempting to detach device vdb from instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:25:32 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:25:32 user nova-compute[73503]:   <source dev="/dev/sdd"/>
Aug 26 13:25:32 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:25:32 user nova-compute[73503]:   <serial>80a37ad7-c57d-42dc-9d55-fdb1a58305cb</serial>
Aug 26 13:25:32 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:25:32 user nova-compute[73503]: </disk>
Aug 26 13:25:32 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:25:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully detached device vdb from instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 from the persistent domain config.
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:25:32 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:25:32 user nova-compute[73503]:   <source dev="/dev/sdd"/>
Aug 26 13:25:32 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:25:32 user nova-compute[73503]:   <serial>80a37ad7-c57d-42dc-9d55-fdb1a58305cb</serial>
Aug 26 13:25:32 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:25:32 user nova-compute[73503]: </disk>
Aug 26 13:25:32 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.network.neutron [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updated VIF entry in instance network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.network.neutron [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f8d5357-d0ca-4571-82e3-26360584bfa5 req-d373b481-1e0e-452f-9ba3-5c4d0c8aa6de service nova] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056332.8065164, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:25:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully detached device vdb from instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 from the live domain config.
Aug 26 13:25:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rJOQbVdZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:32 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[314b1304-bb30-4291-80d0-bfcd2d171e19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcbd9b5-aad8-4468-88ba-678bf50ee4e2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:32 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:32 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:32 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30440ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb'): ({'sdd'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Removing single pathed devices sdd {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eeb5ae-c792-4792-b61e-09058f31987b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaee604-6e7a-48be-bf08-c50226e9ebb0]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Flushing IO for device /dev/sdd {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22739fa-d1a3-4656-b5e7-349f6278e278]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:25:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df98062-c12a-4f8d-8bfd-67247746d956]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b8819d-24a9-4da8-8c0d-147f7703cc0f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba90bf-c333-4358-9ff9-5585eccf45d4]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260]
Aug 26 13:25:33 user nova-compute[73503]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb, portal: 172.16.0.220,3260] successful.
Aug 26 13:25:33 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a37ad7-c57d-42dc-9d55-fdb1a58305cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dee647-1327-4c14-8cd9-3aeaf621e011]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] <== disconnect_volume: return (358ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing instance network info cache due to event network-changed-a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] Acquiring lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] Acquired lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:33 user nova-compute[73503]: DEBUG nova.network.neutron [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Refreshing network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:25:34 user nova-compute[73503]: DEBUG nova.objects.instance [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'flavor' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-74d5bf47-9a8e-4aba-971a-3ebbd688ef6b tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.036s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:34 user nova-compute[73503]: DEBUG nova.network.neutron [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updated VIF entry in instance network info cache for port a1b437ed-6a04-4d98-af40-196b0ba33def. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:25:34 user nova-compute[73503]: DEBUG nova.network.neutron [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [{"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-30a072dd-100c-457c-91d3-c4e9ff99b4e2 req-3615fe32-a911-485d-9a99-6233f22987df service nova] Releasing lock "refresh_cache-2a7f4f67-ae12-4760-b45a-77e9cca24132" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:35 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056320.4169085, c7eb91d5-a544-464f-9bd5-26f579f05222 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:25:35 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] VM Stopped (Lifecycle Event)
Aug 26 13:25:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a38def6c-3e08-46bb-b1b5-7f05f9286e36 None None] [instance: c7eb91d5-a544-464f-9bd5-26f579f05222] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:25:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-changed-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Refreshing instance network info cache due to event network-changed-c5c78c00-058e-41ea-af3a-af42ac631c31. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] Acquiring lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] Acquired lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Refreshing network info cache for port c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2532b05a-30b5-4516-b701-6fbc71e74352" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:51 user nova-compute[73503]: INFO nova.compute.manager [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Terminating instance
Aug 26 13:25:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Updated VIF entry in instance network info cache for port c5c78c00-058e-41ea-af3a-af42ac631c31. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Updating instance_info_cache with network_info: [{"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75719c79-c724-4b31-9a5b-532cbcc0c96e req-408b5e22-fb60-430f-85f2-5d3c1daa5309 service nova] Releasing lock "refresh_cache-2532b05a-30b5-4516-b701-6fbc71e74352" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Instance destroyed successfully.
Aug 26 13:25:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'resources' on Instance uuid 2532b05a-30b5-4516-b701-6fbc71e74352 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874120062',display_name='tempest-AttachVolumeNegativeTest-server-874120062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874120062',id=27,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXYnvSb2y7vcC9UEs9E0x6blyQRqwswCG2x9yv8Z89LHBItMV4kcli42KhbgmIY3tTYOhWNbFSwHjc402fJxQmLkMr8FdNiVll4TxUSAFAORckzIoCzYmH/nlLG2iCPug==',key_name='tempest-keypair-1687127282',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:24:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-lva186o4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=2532b05a-30b5-4516-b701-6fbc71e74352,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "c5c78c00-058e-41ea-af3a-af42ac631c31", "address": "fa:16:3e:76:de:c1", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c78c00-05", "ovs_interfaceid": "c5c78c00-058e-41ea-af3a-af42ac631c31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG os_vif [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5c78c00-05, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:25:52 user nova-compute[73503]: INFO os_vif [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:c1,bridge_name='br-int',has_traffic_filtering=True,id=c5c78c00-058e-41ea-af3a-af42ac631c31,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c78c00-05')
Aug 26 13:25:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Deleting instance files /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352_del
Aug 26 13:25:52 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Deletion of /opt/stack/data/nova/instances/2532b05a-30b5-4516-b701-6fbc71e74352_del complete
Aug 26 13:25:52 user nova-compute[73503]: INFO nova.compute.manager [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 13:25:52 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:25:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-vif-unplugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] No waiting events found dispatching network-vif-unplugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-vif-unplugged-c5c78c00-058e-41ea-af3a-af42ac631c31 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] Acquiring lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] Lock "2532b05a-30b5-4516-b701-6fbc71e74352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] No waiting events found dispatching network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:53 user nova-compute[73503]: WARNING nova.compute.manager [req-9bfd2f6d-facf-452e-a3e5-93dd27119b3b req-22b9c24e-2b75-4256-9d57-98389862cc42 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received unexpected event network-vif-plugged-c5c78c00-058e-41ea-af3a-af42ac631c31 for instance with vm_state active and task_state deleting.
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:53 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Took 0.87 seconds to deallocate network for instance.
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:53 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Deleted allocations for instance 2532b05a-30b5-4516-b701-6fbc71e74352
Aug 26 13:25:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e6fee9f-0d35-4094-b346-0ebf1cb87d0a tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2532b05a-30b5-4516-b701-6fbc71e74352" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-95f62331-a8c9-490a-b46c-3e0e06747bab req-6a3fb498-d39b-47fa-ab3b-810122f1ab62 service nova] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Received event network-vif-deleted-c5c78c00-058e-41ea-af3a-af42ac631c31 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "d13159b8-3de6-4480-9762-df9c558096f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:56 user nova-compute[73503]: INFO nova.compute.manager [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Terminating instance
Aug 26 13:25:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Instance destroyed successfully.
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.objects.instance [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'resources' on Instance uuid d13159b8-3de6-4480-9762-df9c558096f3 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-432592566',display_name='tempest-TestVolumeBootPattern-server-432592566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-432592566',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:24:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-lx4bo9fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:24:32Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=d13159b8-3de6-4480-9762-df9c558096f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "b490812e-c54d-47ce-b1c2-a1a941161a87", "address": "fa:16:3e:cd:12:f8", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb490812e-c5", "ovs_interfaceid": "b490812e-c54d-47ce-b1c2-a1a941161a87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_vif [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb490812e-c5, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:25:57 user nova-compute[73503]: INFO os_vif [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:f8,bridge_name='br-int',has_traffic_filtering=True,id=b490812e-c54d-47ce-b1c2-a1a941161a87,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb490812e-c5')
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dbmlBvpC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:25:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e09b11b-c1ec-41c2-9cfb-a032feaf6627]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-vif-unplugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] No waiting events found dispatching network-vif-unplugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-vif-unplugged-b490812e-c54d-47ce-b1c2-a1a941161a87 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] Acquiring lock "d13159b8-3de6-4480-9762-df9c558096f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] Lock "d13159b8-3de6-4480-9762-df9c558096f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] No waiting events found dispatching network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:25:57 user nova-compute[73503]: WARNING nova.compute.manager [req-8f2b075f-df4d-4099-ae92-04a378372234 req-a9bdfe90-3e0e-4050-9112-9edba1970e3a service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received unexpected event network-vif-plugged-b490812e-c54d-47ce-b1c2-a1a941161a87 for instance with vm_state active and task_state deleting.
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e16c4e5-254b-4034-affb-6ecdcebe146a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:25:57 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:25:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304522e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13'): ({'sdh'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Removing single pathed devices sdh {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae16ba2-9fe7-445e-8bdd-07099457b934]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a7050a-0536-4dee-bece-47f579f0c3de]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flushing IO for device /dev/sdh {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade9ed9-d040-479d-a838-69da0d7b08ce]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62e427d-3f1e-420d-9061-3e4fe190ca82]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] SCSI volumes sdh have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d9c22ac2', '/dev/disk/by-id/scsi-1SCST_BIOd9c22ac2-2434de2308e5712b', '/dev/disk/by-id/scsi-23234333464653233') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ac312e-b117-4303-b6ff-bd4ae6ebb879]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f8454-0c93-4515-b40d-c59c6f74ad63]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[51413141-3959-4d2b-a211-24b0e61d1e6f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260]
Aug 26 13:25:57 user nova-compute[73503]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13, portal: 172.16.0.220,3260] successful.
Aug 26 13:25:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dfda802-6e1b-4e74-a56f-d07b5ac11b13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfc635f-0836-42dc-a7e8-f976fd6e86ca]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== disconnect_volume: return (290ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:25:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Deleting instance files /opt/stack/data/nova/instances/d13159b8-3de6-4480-9762-df9c558096f3_del
Aug 26 13:25:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Deletion of /opt/stack/data/nova/instances/d13159b8-3de6-4480-9762-df9c558096f3_del complete
Aug 26 13:25:57 user nova-compute[73503]: INFO nova.compute.manager [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 26 13:25:57 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:25:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:25:58 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:25:58 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Took 0.76 seconds to deallocate network for instance.
Aug 26 13:25:59 user nova-compute[73503]: INFO nova.compute.manager [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 13:25:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Deleting volume: 7dfda802-6e1b-4e74-a56f-d07b5ac11b13 {{(pid=73503) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 13:25:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:25:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:25:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-dbc338c0-d3cc-4585-bf72-cf812c37e28f req-9374dfdd-1335-4bba-a0e0-c7a4be958448 service nova] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Received event network-vif-deleted-b490812e-c54d-47ce-b1c2-a1a941161a87 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:25:59 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:25:59 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:25:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:25:59 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Deleted allocations for instance d13159b8-3de6-4480-9762-df9c558096f3
Aug 26 13:25:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-efcbbc97-b584-4370-a396-9db7b2b023d4 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "d13159b8-3de6-4480-9762-df9c558096f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.310s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:26:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:06 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:26:06 user nova-compute[73503]: INFO nova.compute.claims [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Claim successful on node user
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:26:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056352.3444993, 2532b05a-30b5-4516-b701-6fbc71e74352 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:07 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] VM Stopped (Lifecycle Event)
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.policy [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a89a1af8a5843ed93bf6f11556e1f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b965a76e3c04068b81deca48c6efba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1bf8b5a5-b88e-4937-8dfc-0465a3badc6f None None] [instance: 2532b05a-30b5-4516-b701-6fbc71e74352] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:26:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Creating image(s)
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk 1073741824" returned: 0 in 0.060s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Successfully created port: 091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Cannot resize image /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Ensure instance console log exists: /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Successfully updated port: 091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-changed-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Refreshing instance network info cache due to event network-changed-091e82ff-8900-424d-83be-6044ae067340. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:26:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] Acquiring lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.neutron [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.neutron [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updating instance_info_cache with network_info: [{"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Instance network_info: |[{"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] Acquired lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Refreshing network info cache for port 091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Start _get_guest_xml network_info=[{"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:26:09 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:26:09 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-198714207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-198714207',id=31,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-f2fxyni7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:26:07Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=d0fab249-2251-46e5-8b6e-83df64db1cf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.objects.instance [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'pci_devices' on Instance uuid d0fab249-2251-46e5-8b6e-83df64db1cf2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:26:09 user nova-compute[73503]:   <uuid>d0fab249-2251-46e5-8b6e-83df64db1cf2</uuid>
Aug 26 13:26:09 user nova-compute[73503]:   <name>instance-0000001f</name>
Aug 26 13:26:09 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:26:09 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:26:09 user nova-compute[73503]:   <metadata>
Aug 26 13:26:09 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:26:09 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:26:09 user nova-compute[73503]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-198714207</nova:name>
Aug 26 13:26:09 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:26:09</nova:creationTime>
Aug 26 13:26:09 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:26:09 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:26:09 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:26:09 user nova-compute[73503]:       <nova:owner>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:user uuid="1a89a1af8a5843ed93bf6f11556e1f65">tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member</nova:user>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:project uuid="9b965a76e3c04068b81deca48c6efba6">tempest-ServerBootFromVolumeStableRescueTest-1652147779</nova:project>
Aug 26 13:26:09 user nova-compute[73503]:       </nova:owner>
Aug 26 13:26:09 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:26:09 user nova-compute[73503]:       <nova:ports>
Aug 26 13:26:09 user nova-compute[73503]:         <nova:port uuid="091e82ff-8900-424d-83be-6044ae067340">
Aug 26 13:26:09 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 13:26:09 user nova-compute[73503]:         </nova:port>
Aug 26 13:26:09 user nova-compute[73503]:       </nova:ports>
Aug 26 13:26:09 user nova-compute[73503]:     </nova:instance>
Aug 26 13:26:09 user nova-compute[73503]:   </metadata>
Aug 26 13:26:09 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:26:09 user nova-compute[73503]:     <system>
Aug 26 13:26:09 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:26:09 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:26:09 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:26:09 user nova-compute[73503]:       <entry name="serial">d0fab249-2251-46e5-8b6e-83df64db1cf2</entry>
Aug 26 13:26:09 user nova-compute[73503]:       <entry name="uuid">d0fab249-2251-46e5-8b6e-83df64db1cf2</entry>
Aug 26 13:26:09 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:26:09 user nova-compute[73503]:     </system>
Aug 26 13:26:09 user nova-compute[73503]:   </sysinfo>
Aug 26 13:26:09 user nova-compute[73503]:   <os>
Aug 26 13:26:09 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:26:09 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:26:09 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:26:09 user nova-compute[73503]:   </os>
Aug 26 13:26:09 user nova-compute[73503]:   <features>
Aug 26 13:26:09 user nova-compute[73503]:     <acpi/>
Aug 26 13:26:09 user nova-compute[73503]:     <apic/>
Aug 26 13:26:09 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:26:09 user nova-compute[73503]:   </features>
Aug 26 13:26:09 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:26:09 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:26:09 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:26:09 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:26:09 user nova-compute[73503]:   </clock>
Aug 26 13:26:09 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:26:09 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:26:09 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:26:09 user nova-compute[73503]:   </cpu>
Aug 26 13:26:09 user nova-compute[73503]:   <devices>
Aug 26 13:26:09 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:26:09 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:26:09 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk"/>
Aug 26 13:26:09 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:26:09 user nova-compute[73503]:     </disk>
Aug 26 13:26:09 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:26:09 user nova-compute[73503]:       <mac address="fa:16:3e:7f:92:c3"/>
Aug 26 13:26:09 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:26:09 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:26:09 user nova-compute[73503]:       <target dev="tap091e82ff-89"/>
Aug 26 13:26:09 user nova-compute[73503]:     </interface>
Aug 26 13:26:09 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:26:09 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/console.log" append="off"/>
Aug 26 13:26:09 user nova-compute[73503]:     </serial>
Aug 26 13:26:09 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:26:09 user nova-compute[73503]:     <video>
Aug 26 13:26:09 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:26:09 user nova-compute[73503]:     </video>
Aug 26 13:26:09 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:26:09 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:26:09 user nova-compute[73503]:     </rng>
Aug 26 13:26:09 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:26:09 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:26:09 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:26:09 user nova-compute[73503]:     </memballoon>
Aug 26 13:26:09 user nova-compute[73503]:   </devices>
Aug 26 13:26:09 user nova-compute[73503]: </domain>
Aug 26 13:26:09 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-198714207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-198714207',id=31,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-f2fxyni7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:26:07Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=d0fab249-2251-46e5-8b6e-83df64db1cf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG os_vif [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091e82ff-89, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap091e82ff-89, col_values=(('external_ids', {'iface-id': '091e82ff-8900-424d-83be-6044ae067340', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:92:c3', 'vm-uuid': 'd0fab249-2251-46e5-8b6e-83df64db1cf2'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:09 user nova-compute[73503]: INFO os_vif [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89')
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No VIF found with MAC fa:16:3e:7f:92:c3, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updated VIF entry in instance network info cache for port 091e82ff-8900-424d-83be-6044ae067340. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updating instance_info_cache with network_info: [{"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-63f12670-3fa5-40ea-950a-6325fbd73891 req-387941f6-2fc6-46d8-aae1-01a43e8e2eb7 service nova] Releasing lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-04dd1115-6ffd-489a-8aa7-91cb6f5f1049 req-e5b12242-8907-4348-966d-4dc6332460fc service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-04dd1115-6ffd-489a-8aa7-91cb6f5f1049 req-e5b12242-8907-4348-966d-4dc6332460fc service nova] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-04dd1115-6ffd-489a-8aa7-91cb6f5f1049 req-e5b12242-8907-4348-966d-4dc6332460fc service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-04dd1115-6ffd-489a-8aa7-91cb6f5f1049 req-e5b12242-8907-4348-966d-4dc6332460fc service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-04dd1115-6ffd-489a-8aa7-91cb6f5f1049 req-e5b12242-8907-4348-966d-4dc6332460fc service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] No waiting events found dispatching network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:11 user nova-compute[73503]: WARNING nova.compute.manager [req-04dd1115-6ffd-489a-8aa7-91cb6f5f1049 req-e5b12242-8907-4348-966d-4dc6332460fc service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received unexpected event network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 for instance with vm_state building and task_state spawning.
Aug 26 13:26:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:12 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056357.2278087, d13159b8-3de6-4480-9762-df9c558096f3 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:12 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: d13159b8-3de6-4480-9762-df9c558096f3] VM Stopped (Lifecycle Event)
Aug 26 13:26:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1057d248-05ed-4cb7-b598-8981f03f423d None None] [instance: d13159b8-3de6-4480-9762-df9c558096f3] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:26:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056373.003596, d0fab249-2251-46e5-8b6e-83df64db1cf2 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] VM Resumed (Lifecycle Event)
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Instance spawned successfully.
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056373.0051436, d0fab249-2251-46e5-8b6e-83df64db1cf2 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] VM Started (Lifecycle Event)
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-2a37158f-e88b-4822-831d-dd6f0a68f2ab req-38017b29-5711-4722-99ed-34af2dc33bdf service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2a37158f-e88b-4822-831d-dd6f0a68f2ab req-38017b29-5711-4722-99ed-34af2dc33bdf service nova] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2a37158f-e88b-4822-831d-dd6f0a68f2ab req-38017b29-5711-4722-99ed-34af2dc33bdf service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2a37158f-e88b-4822-831d-dd6f0a68f2ab req-38017b29-5711-4722-99ed-34af2dc33bdf service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-2a37158f-e88b-4822-831d-dd6f0a68f2ab req-38017b29-5711-4722-99ed-34af2dc33bdf service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] No waiting events found dispatching network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:13 user nova-compute[73503]: WARNING nova.compute.manager [req-2a37158f-e88b-4822-831d-dd6f0a68f2ab req-38017b29-5711-4722-99ed-34af2dc33bdf service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received unexpected event network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 for instance with vm_state building and task_state spawning.
Aug 26 13:26:13 user nova-compute[73503]: INFO nova.compute.manager [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Took 6.52 seconds to build instance.
Aug 26 13:26:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-72536359-4abf-48ef-a761-fe7150f6bb4f tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.625s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:26:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [{"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-9a0a305a-0375-41a9-9b51-a78d65270f43" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:26:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:22 user nova-compute[73503]: INFO nova.compute.manager [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Terminating instance
Aug 26 13:26:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-1f501f43-5217-4d75-b8cc-59f4b1cbcc39 req-4d7e6aeb-fa25-4e87-8d6d-207bc30d64ee service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1f501f43-5217-4d75-b8cc-59f4b1cbcc39 req-4d7e6aeb-fa25-4e87-8d6d-207bc30d64ee service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1f501f43-5217-4d75-b8cc-59f4b1cbcc39 req-4d7e6aeb-fa25-4e87-8d6d-207bc30d64ee service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1f501f43-5217-4d75-b8cc-59f4b1cbcc39 req-4d7e6aeb-fa25-4e87-8d6d-207bc30d64ee service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-1f501f43-5217-4d75-b8cc-59f4b1cbcc39 req-4d7e6aeb-fa25-4e87-8d6d-207bc30d64ee service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-1f501f43-5217-4d75-b8cc-59f4b1cbcc39 req-4d7e6aeb-fa25-4e87-8d6d-207bc30d64ee service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Instance destroyed successfully.
Aug 26 13:26:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'resources' on Instance uuid 2a7f4f67-ae12-4760-b45a-77e9cca24132 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:19:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1641088509',display_name='tempest-ServerRescueNegativeTestJSON-server-1641088509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1641088509',id=21,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnijJTcPmg6p6xLu5FGsmewTPcgK1XPz6UAj41pxPqXBHWR8SDB2XgYe3x2ud0QGgrh/tNcxGSlBI6e81S6cuUDM5GjrCOlp4KqymQt8B3qDguHRHeGysDzpBaKdsG+2w==',key_name='tempest-keypair-1726069367',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-stz3l4kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=2a7f4f67-ae12-4760-b45a-77e9cca24132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "a1b437ed-6a04-4d98-af40-196b0ba33def", "address": "fa:16:3e:14:4c:4d", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1b437ed-6a", "ovs_interfaceid": "a1b437ed-6a04-4d98-af40-196b0ba33def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG os_vif [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1b437ed-6a, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:26:23 user nova-compute[73503]: INFO os_vif [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:4c:4d,bridge_name='br-int',has_traffic_filtering=True,id=a1b437ed-6a04-4d98-af40-196b0ba33def,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1b437ed-6a')
Aug 26 13:26:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Deleting instance files /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132_del
Aug 26 13:26:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Deletion of /opt/stack/data/nova/instances/2a7f4f67-ae12-4760-b45a-77e9cca24132_del complete
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: INFO nova.compute.manager [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:24 user nova-compute[73503]: WARNING nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state deleting.
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:24 user nova-compute[73503]: WARNING nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state deleting.
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:24 user nova-compute[73503]: WARNING nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state active and task_state deleting.
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-4095fba3-520c-4629-9d75-e5576b20c8ee req-8a85cee1-651c-4658-9bda-41206a59d79d service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-unplugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:26:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:26:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7063MB free_disk=24.897624969482422GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:25 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Took 1.83 seconds to deallocate network for instance.
Aug 26 13:26:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Applying migration context for instance ac1098c8-c3d6-4f13-9093-3a4100e41299 as it has an incoming, in-progress migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c. Migration status is finished {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 13:26:25 user nova-compute[73503]: INFO nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating resource usage from migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6fb3f5db-a603-4982-8304-c4601a5c5b17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2a7f4f67-ae12-4760-b45a-77e9cca24132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 90c4814c-43f2-454f-964b-6179892193c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9c247e08-3242-4197-9266-15ebf49a7397 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.515s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.724s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:26 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Deleted allocations for instance 2a7f4f67-ae12-4760-b45a-77e9cca24132
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2c2a6-22ad-4637-acbe-8eae2e087aaa tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.266s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "9c247e08-3242-4197-9266-15ebf49a7397" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:26 user nova-compute[73503]: INFO nova.compute.manager [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Terminating instance
Aug 26 13:26:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] Acquiring lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] Lock "2a7f4f67-ae12-4760-b45a-77e9cca24132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] No waiting events found dispatching network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:26 user nova-compute[73503]: WARNING nova.compute.manager [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received unexpected event network-vif-plugged-a1b437ed-6a04-4d98-af40-196b0ba33def for instance with vm_state deleted and task_state None.
Aug 26 13:26:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e1a057d-3764-424b-b56f-07dfe8c96e94 req-5efe3527-67ea-4d28-b353-4b6c13c5b0ec service nova] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Received event network-vif-deleted-a1b437ed-6a04-4d98-af40-196b0ba33def {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-75f91dbc-0ff8-4c9e-a74b-d5b09ae2a0d6 req-f6cc5994-89d2-47b1-999f-28eda6f4c450 service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-vif-unplugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75f91dbc-0ff8-4c9e-a74b-d5b09ae2a0d6 req-f6cc5994-89d2-47b1-999f-28eda6f4c450 service nova] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75f91dbc-0ff8-4c9e-a74b-d5b09ae2a0d6 req-f6cc5994-89d2-47b1-999f-28eda6f4c450 service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-75f91dbc-0ff8-4c9e-a74b-d5b09ae2a0d6 req-f6cc5994-89d2-47b1-999f-28eda6f4c450 service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-75f91dbc-0ff8-4c9e-a74b-d5b09ae2a0d6 req-f6cc5994-89d2-47b1-999f-28eda6f4c450 service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] No waiting events found dispatching network-vif-unplugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-75f91dbc-0ff8-4c9e-a74b-d5b09ae2a0d6 req-f6cc5994-89d2-47b1-999f-28eda6f4c450 service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-vif-unplugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:26:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Instance destroyed successfully.
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lazy-loading 'resources' on Instance uuid 9c247e08-3242-4197-9266-15ebf49a7397 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1082484482',display_name='tempest-VolumesActionsTest-instance-1082484482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1082484482',id=29,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:24:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36a226ec6751458f9641e74bf28ff17d',ramdisk_id='',reservation_id='r-60s7v9cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1770898695',owner_user_name='tempest-VolumesActionsTest-1770898695-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:24:30Z,user_data=None,user_id='cd36de042b19421e892868e57b21c95d',uuid=9c247e08-3242-4197-9266-15ebf49a7397,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Converting VIF {"id": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "address": "fa:16:3e:e8:0f:cb", "network": {"id": "1a4cef0f-113e-43c4-a245-0c20c4262c5f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-385781318-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a226ec6751458f9641e74bf28ff17d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb292dcbd-1b", "ovs_interfaceid": "b292dcbd-1b73-45db-9e48-4e09424d21b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG os_vif [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb292dcbd-1b, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:26:27 user nova-compute[73503]: INFO os_vif [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:0f:cb,bridge_name='br-int',has_traffic_filtering=True,id=b292dcbd-1b73-45db-9e48-4e09424d21b7,network=Network(1a4cef0f-113e-43c4-a245-0c20c4262c5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb292dcbd-1b')
Aug 26 13:26:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Deleting instance files /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397_del
Aug 26 13:26:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Deletion of /opt/stack/data/nova/instances/9c247e08-3242-4197-9266-15ebf49a7397_del complete
Aug 26 13:26:27 user nova-compute[73503]: INFO nova.compute.manager [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 13:26:27 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:26:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:28 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:28 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Took 0.87 seconds to deallocate network for instance.
Aug 26 13:26:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:28 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-79832d9f-9017-4203-bfc3-6af8180d4ce9 req-f53b26f8-4151-40c3-bd01-dd657383debc service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-vif-deleted-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:28 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:29 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Deleted allocations for instance 9c247e08-3242-4197-9266-15ebf49a7397
Aug 26 13:26:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-ac276a14-bcc0-4683-b113-3842774fdddb tempest-VolumesActionsTest-1770898695 tempest-VolumesActionsTest-1770898695-project-member] Lock "9c247e08-3242-4197-9266-15ebf49a7397" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-6c6af19b-e5c3-484b-bf3f-f9bec5a89a2a req-d47fd50d-5f1b-4efb-8ebe-dce499ebad9f service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received event network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6c6af19b-e5c3-484b-bf3f-f9bec5a89a2a req-d47fd50d-5f1b-4efb-8ebe-dce499ebad9f service nova] Acquiring lock "9c247e08-3242-4197-9266-15ebf49a7397-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6c6af19b-e5c3-484b-bf3f-f9bec5a89a2a req-d47fd50d-5f1b-4efb-8ebe-dce499ebad9f service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6c6af19b-e5c3-484b-bf3f-f9bec5a89a2a req-d47fd50d-5f1b-4efb-8ebe-dce499ebad9f service nova] Lock "9c247e08-3242-4197-9266-15ebf49a7397-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-6c6af19b-e5c3-484b-bf3f-f9bec5a89a2a req-d47fd50d-5f1b-4efb-8ebe-dce499ebad9f service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] No waiting events found dispatching network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:29 user nova-compute[73503]: WARNING nova.compute.manager [req-6c6af19b-e5c3-484b-bf3f-f9bec5a89a2a req-d47fd50d-5f1b-4efb-8ebe-dce499ebad9f service nova] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Received unexpected event network-vif-plugged-b292dcbd-1b73-45db-9e48-4e09424d21b7 for instance with vm_state deleted and task_state None.
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-changed-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Refreshing instance network info cache due to event network-changed-ae2804bd-9d88-43ed-bb41-95ca9bbac159. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] Acquiring lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] Acquired lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Refreshing network info cache for port ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:31 user nova-compute[73503]: INFO nova.compute.manager [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Terminating instance
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-567d92e7-93d5-4914-b56f-a5cfb4d56629 req-a1e078e3-a922-4ac0-8b9c-a1e884ef77ad service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-vif-unplugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-567d92e7-93d5-4914-b56f-a5cfb4d56629 req-a1e078e3-a922-4ac0-8b9c-a1e884ef77ad service nova] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-567d92e7-93d5-4914-b56f-a5cfb4d56629 req-a1e078e3-a922-4ac0-8b9c-a1e884ef77ad service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-567d92e7-93d5-4914-b56f-a5cfb4d56629 req-a1e078e3-a922-4ac0-8b9c-a1e884ef77ad service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-567d92e7-93d5-4914-b56f-a5cfb4d56629 req-a1e078e3-a922-4ac0-8b9c-a1e884ef77ad service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] No waiting events found dispatching network-vif-unplugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-567d92e7-93d5-4914-b56f-a5cfb4d56629 req-a1e078e3-a922-4ac0-8b9c-a1e884ef77ad service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-vif-unplugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updated VIF entry in instance network info cache for port ae2804bd-9d88-43ed-bb41-95ca9bbac159. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG nova.network.neutron [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating instance_info_cache with network_info: [{"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-898fa540-6970-4826-9a78-241a347a3251 req-7f4d71e2-e4ac-47f7-bc1e-7891418dd2c1 service nova] Releasing lock "refresh_cache-6fb3f5db-a603-4982-8304-c4601a5c5b17" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Instance destroyed successfully.
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.objects.instance [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lazy-loading 'resources' on Instance uuid 6fb3f5db-a603-4982-8304-c4601a5c5b17 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2055044220',display_name='tempest-TestStampPattern-server-2055044220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2055044220',id=19,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn2+pFLZ2VSZx7AckabSo562zlp19RUMBiOGyV73023vTl3GUKSePV72rfCWrRK/uBW0wHSSndFaIZ2aHgqtusbD669E0l1ESLIroNlZsjUuKyclKN2VYcnFWYA9yluhg==',key_name='tempest-TestStampPattern-764130994',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:19:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af4179d75d5a49ffa8caae46f900f993',ramdisk_id='',reservation_id='r-bh5uct02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-585487806',owner_user_name='tempest-TestStampPattern-585487806-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:22:13Z,user_data=None,user_id='a8afe79d50d64cc3b087d5ecaacc66cb',uuid=6fb3f5db-a603-4982-8304-c4601a5c5b17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converting VIF {"id": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "address": "fa:16:3e:e2:79:e7", "network": {"id": "8dea5abd-72f0-459a-8dad-b55c5e08aaf2", "bridge": "br-int", "label": "tempest-TestStampPattern-1440900851-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af4179d75d5a49ffa8caae46f900f993", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2804bd-9d", "ovs_interfaceid": "ae2804bd-9d88-43ed-bb41-95ca9bbac159", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG os_vif [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2804bd-9d, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:32 user nova-compute[73503]: INFO os_vif [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:79:e7,bridge_name='br-int',has_traffic_filtering=True,id=ae2804bd-9d88-43ed-bb41-95ca9bbac159,network=Network(8dea5abd-72f0-459a-8dad-b55c5e08aaf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2804bd-9d')
Aug 26 13:26:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Deleting instance files /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17_del
Aug 26 13:26:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Deletion of /opt/stack/data/nova/instances/6fb3f5db-a603-4982-8304-c4601a5c5b17_del complete
Aug 26 13:26:32 user nova-compute[73503]: INFO nova.compute.manager [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 13:26:32 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:32 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Took 0.53 seconds to deallocate network for instance.
Aug 26 13:26:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:33 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Deleted allocations for instance 6fb3f5db-a603-4982-8304-c4601a5c5b17
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-56a0c397-e515-4254-99a3-daef9d37239c req-0e09667e-5483-44e5-8948-554d4f0bcd94 service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-vif-deleted-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d9b2f58-0250-40fb-9ea6-807d7680993b tempest-TestStampPattern-585487806 tempest-TestStampPattern-585487806-project-member] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received event network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] Acquiring lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] Lock "6fb3f5db-a603-4982-8304-c4601a5c5b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] No waiting events found dispatching network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:33 user nova-compute[73503]: WARNING nova.compute.manager [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Received unexpected event network-vif-plugged-ae2804bd-9d88-43ed-bb41-95ca9bbac159 for instance with vm_state deleted and task_state None.
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing instance network info cache due to event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:33 user nova-compute[73503]: DEBUG nova.network.neutron [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:26:34 user nova-compute[73503]: DEBUG nova.network.neutron [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updated VIF entry in instance network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:26:34 user nova-compute[73503]: DEBUG nova.network.neutron [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-52784548-adb8-496c-b382-2b483817f6fb req-e3774435-abd9-4ddb-a0f2-d22d1a9d071b service nova] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:38 user nova-compute[73503]: INFO nova.compute.manager [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Shelving
Aug 26 13:26:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056383.3317542, 2a7f4f67-ae12-4760-b45a-77e9cca24132 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:38 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] VM Stopped (Lifecycle Event)
Aug 26 13:26:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-ff10cdb7-e02d-41cb-a676-3de4d704643b None None] [instance: 2a7f4f67-ae12-4760-b45a-77e9cca24132] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9af5948-38e6-438f-8a70-3f107d5f7bef req-5b0a6203-71df-488f-ac13-970be486694b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-unplugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9af5948-38e6-438f-8a70-3f107d5f7bef req-5b0a6203-71df-488f-ac13-970be486694b service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9af5948-38e6-438f-8a70-3f107d5f7bef req-5b0a6203-71df-488f-ac13-970be486694b service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9af5948-38e6-438f-8a70-3f107d5f7bef req-5b0a6203-71df-488f-ac13-970be486694b service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9af5948-38e6-438f-8a70-3f107d5f7bef req-5b0a6203-71df-488f-ac13-970be486694b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-unplugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:38 user nova-compute[73503]: WARNING nova.compute.manager [req-b9af5948-38e6-438f-8a70-3f107d5f7bef req-5b0a6203-71df-488f-ac13-970be486694b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-unplugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state active and task_state shelving.
Aug 26 13:26:39 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance destroyed successfully.
Aug 26 13:26:39 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Beginning cold snapshot process
Aug 26 13:26:39 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:26:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk /opt/stack/data/nova/instances/snapshots/tmpn34etbqm/65b030d70662417692d0908e9e2bac12 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk /opt/stack/data/nova/instances/snapshots/tmpn34etbqm/65b030d70662417692d0908e9e2bac12" returned: 0 in 0.890s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Snapshot extracted, beginning image upload
Aug 26 13:26:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-fbe9dc39-d940-4b2b-bb10-8ab3f72994dd req-4f6f3cc5-f83d-4b82-b908-114bfb128882 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fbe9dc39-d940-4b2b-bb10-8ab3f72994dd req-4f6f3cc5-f83d-4b82-b908-114bfb128882 service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fbe9dc39-d940-4b2b-bb10-8ab3f72994dd req-4f6f3cc5-f83d-4b82-b908-114bfb128882 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fbe9dc39-d940-4b2b-bb10-8ab3f72994dd req-4f6f3cc5-f83d-4b82-b908-114bfb128882 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-fbe9dc39-d940-4b2b-bb10-8ab3f72994dd req-4f6f3cc5-f83d-4b82-b908-114bfb128882 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:26:40 user nova-compute[73503]: WARNING nova.compute.manager [req-fbe9dc39-d940-4b2b-bb10-8ab3f72994dd req-4f6f3cc5-f83d-4b82-b908-114bfb128882 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 13:26:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:42 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056387.5935576, 9c247e08-3242-4197-9266-15ebf49a7397 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:42 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] VM Stopped (Lifecycle Event)
Aug 26 13:26:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8397f7c9-8a13-4699-a7f0-2c2757884250 None None] [instance: 9c247e08-3242-4197-9266-15ebf49a7397] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Snapshot image upload complete
Aug 26 13:26:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:42 user nova-compute[73503]: INFO nova.compute.manager [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Shelve offloading
Aug 26 13:26:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance destroyed successfully.
Aug 26 13:26:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:26:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.compute.manager [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Detaching volume 83f8cc40-22da-48a8-b6f6-8a41970d912e
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.virt.block_device [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Attempting to driver detach volume 83f8cc40-22da-48a8-b6f6-8a41970d912e from mountpoint /dev/vdb
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Attempting to detach device vdb from instance 90c4814c-43f2-454f-964b-6179892193c1 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:26:43 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:26:43 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:26:43 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:26:43 user nova-compute[73503]:   <serial>83f8cc40-22da-48a8-b6f6-8a41970d912e</serial>
Aug 26 13:26:43 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:26:43 user nova-compute[73503]: </disk>
Aug 26 13:26:43 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully detached device vdb from instance 90c4814c-43f2-454f-964b-6179892193c1 from the persistent domain config.
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90c4814c-43f2-454f-964b-6179892193c1 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:26:43 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:26:43 user nova-compute[73503]:   <source dev="/dev/sdf"/>
Aug 26 13:26:43 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:26:43 user nova-compute[73503]:   <serial>83f8cc40-22da-48a8-b6f6-8a41970d912e</serial>
Aug 26 13:26:43 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:26:43 user nova-compute[73503]: </disk>
Aug 26 13:26:43 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.network.neutron [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056403.5541966, 90c4814c-43f2-454f-964b-6179892193c1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90c4814c-43f2-454f-964b-6179892193c1 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully detached device vdb from instance 90c4814c-43f2-454f-964b-6179892193c1 from the live domain config.
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXsfCQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:26:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddef926-6ce6-4156-8c7a-41f49fa598f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[36744fde-8f88-408a-a4e4-6eae05bcdd1a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:26:43 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:26:43 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:26:43 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:26:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:26:43 user nova-compute[73503]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e (non-flash)
Aug 26 13:26:43 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:26:43 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:26:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045a8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e'): ({'sdf'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Removing single pathed devices sdf {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57556fae-1f1d-4aa7-83fc-f4849cf51895]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a002b2a-f996-4c46-be4e-33e0c0980141]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flushing IO for device /dev/sdf {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7e842-59a0-49a8-9b62-c2bca3e95a77]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ff9a63-cf02-41aa-a0e8-b91481a2d1b0]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8512850-52f7-4b22-93ed-04f7284c627a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e04b31-00ea-4b77-8a2c-f33d3aa60e78]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260]
Aug 26 13:26:43 user nova-compute[73503]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e, portal: 172.16.0.220,3260] successful.
Aug 26 13:26:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f8cc40-22da-48a8-b6f6-8a41970d912e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ed2c07-cb98-42ca-a2ba-0564fe7f9478]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== disconnect_volume: return (313ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance destroyed successfully.
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.objects.instance [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'resources' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523018557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523018557',id=30,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsm5frv1VuuEfrbMMQ549CCXk5wbnIAmA0b4+c+RMyqih7oGJ2x7c2afjSVPKpVDBQ0dvlOa4mu4u7bqWODprP5bQg56UELrAGvuBzB0WlZ0anIC45pthw7Asz8KRdnQ==',key_name='tempest-keypair-1858926900',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:24:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-9bgjnz2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member',shelved_at='2023-08-26T13:26:42.650408',shelved_host='user',shelved_image_id='585a6f82-50b0-4727-b351-d772978deb32'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:26:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG os_vif [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038813f4-35, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing instance network info cache due to event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:26:43 user nova-compute[73503]: INFO os_vif [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35')
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Deleting instance files /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02_del
Aug 26 13:26:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Deletion of /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02_del complete
Aug 26 13:26:44 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Deleted allocations for instance 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02
Aug 26 13:26:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.objects.base [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02> lazy-loaded attributes: resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updated VIF entry in instance network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap038813f4-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1717419f-baa3-4d03-810d-f3376a71a4d4 req-7e444ca3-cab8-4d24-8a99-160d90ba2d6b service nova] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-40db55b4-42e9-41ce-baf3-07a64f13f9e0 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.357s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 90c4814c-43f2-454f-964b-6179892193c1 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5d8887d1-1b66-4667-9787-697f8e1a0dca tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:47 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056392.1063023, 6fb3f5db-a603-4982-8304-c4601a5c5b17 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:47 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] VM Stopped (Lifecycle Event)
Aug 26 13:26:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7bd727a6-ae86-430e-921b-a6a3e9915b40 None None] [instance: 6fb3f5db-a603-4982-8304-c4601a5c5b17] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Going to confirm migration 2 {{(pid=73503) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquired lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'info_cache' on Instance uuid ac1098c8-c3d6-4f13-9093-3a4100e41299 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056399.015674, 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:26:54 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] VM Stopped (Lifecycle Event)
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-46d42134-5ed0-4e58-a0c2-70f07f71477c None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [{"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Releasing lock "refresh_cache-ac1098c8-c3d6-4f13-9093-3a4100e41299" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'migration_context' on Instance uuid ac1098c8-c3d6-4f13-9093-3a4100e41299 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.objects.base [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Object Instance<ac1098c8-c3d6-4f13-9093-3a4100e41299> lazy-loaded attributes: info_cache,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:26:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.338s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:54 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Deleted allocation for migration 9095adca-9036-4dd5-b4d4-8ec78e20b85c
Aug 26 13:26:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d32308f3-9945-466f-9493-a5a2e71f37a5 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.382s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:26:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:27:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:09 user nova-compute[73503]: INFO nova.compute.manager [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Detaching volume 06b2c1b8-db21-46ba-8979-b57ff7535691
Aug 26 13:27:09 user nova-compute[73503]: INFO nova.virt.block_device [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Attempting to driver detach volume 06b2c1b8-db21-46ba-8979-b57ff7535691 from mountpoint /dev/vdb
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Attempting to detach device vdb from instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:27:09 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:27:09 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:27:09 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:27:09 user nova-compute[73503]:   <serial>06b2c1b8-db21-46ba-8979-b57ff7535691</serial>
Aug 26 13:27:09 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:27:09 user nova-compute[73503]: </disk>
Aug 26 13:27:09 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:27:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully detached device vdb from instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec from the persistent domain config.
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:27:09 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:27:09 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:27:09 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:27:09 user nova-compute[73503]:   <serial>06b2c1b8-db21-46ba-8979-b57ff7535691</serial>
Aug 26 13:27:09 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:27:09 user nova-compute[73503]: </disk>
Aug 26 13:27:09 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056429.9136877, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:27:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully detached device vdb from instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec from the live domain config.
Aug 26 13:27:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmUyJTdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:27:09 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d856009-1795-4c4d-a655-3fab92f33fbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27035239-6643-4219-90ea-97b2ed39fb40]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:27:09 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:27:09 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:27:09 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:27:09 user nova-compute[73503]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 (non-flash)
Aug 26 13:27:09 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:27:09 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd314300160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:27:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84f9304-e25a-4b14-b154-ce6d94910d56]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e62393-5349-4577-9f57-df94d3850d56]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[365b55e5-7732-4306-900b-df69a05f90f1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116cc1d-619d-40b8-812b-32f774e8cf26]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d2a3c-346b-4f33-b882-76e62605166c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb2c65f-71f0-4391-a0ca-aebcb77fe509]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260]
Aug 26 13:27:10 user nova-compute[73503]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691, portal: 172.16.0.220,3260] successful.
Aug 26 13:27:10 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06b2c1b8-db21-46ba-8979-b57ff7535691 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db5f1df-9fc3-4d45-89a6-84cd81640841]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== disconnect_volume: return (280ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:27:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-735948b2-994c-4d5f-9dc8-48dddbf51867 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73503) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG nova.objects.instance [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance destroyed successfully.
Aug 26 13:27:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-47b7b994-ff48-4c4e-a4a9-f71d453bee02 req-2d498c19-93e4-4816-90dc-831343289ebb service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-47b7b994-ff48-4c4e-a4a9-f71d453bee02 req-2d498c19-93e4-4816-90dc-831343289ebb service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-47b7b994-ff48-4c4e-a4a9-f71d453bee02 req-2d498c19-93e4-4816-90dc-831343289ebb service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-47b7b994-ff48-4c4e-a4a9-f71d453bee02 req-2d498c19-93e4-4816-90dc-831343289ebb service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-47b7b994-ff48-4c4e-a4a9-f71d453bee02 req-2d498c19-93e4-4816-90dc-831343289ebb service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:12 user nova-compute[73503]: WARNING nova.compute.manager [req-47b7b994-ff48-4c4e-a4a9-f71d453bee02 req-2d498c19-93e4-4816-90dc-831343289ebb service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state active and task_state powering-off.
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-783d3c90-f9b3-4586-b489-66f2c1734b0a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.841s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:27:12 user nova-compute[73503]: INFO nova.compute.claims [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Claim successful on node user
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:27:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:27:13 user nova-compute[73503]: INFO nova.virt.block_device [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Booting with volume 967b3c6b-66f8-4197-a9f8-de8ee96426c5 at /dev/vda
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.policy [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122b92a79d3242f2903b15430240eace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c42bf18354f55954102eed4da2d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG os_brick.utils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1c856-5877-4af1-9ade-c2c998e9f9e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38d0669-b088-42b6-bf21-86b3d96fae88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee8be65-4b37-4fc6-bf3b-79929565dea0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bc5bbd-bda7-46ba-8287-c36e03283784]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:27:13 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a76244-ad4a-47d7-b482-ed6ea647390b]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG os_brick.utils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updating existing volume attachment record: 9480751e-7415-4ba7-a399-b70eac979a41 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:27:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Successfully created port: 6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-82b2a14a-dd56-495f-b753-2782714b738b req-90a69624-1b6f-4c20-a82c-233fc5672766 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-82b2a14a-dd56-495f-b753-2782714b738b req-90a69624-1b6f-4c20-a82c-233fc5672766 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-82b2a14a-dd56-495f-b753-2782714b738b req-90a69624-1b6f-4c20-a82c-233fc5672766 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-82b2a14a-dd56-495f-b753-2782714b738b req-90a69624-1b6f-4c20-a82c-233fc5672766 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-82b2a14a-dd56-495f-b753-2782714b738b req-90a69624-1b6f-4c20-a82c-233fc5672766 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:14 user nova-compute[73503]: WARNING nova.compute.manager [req-82b2a14a-dd56-495f-b753-2782714b738b req-90a69624-1b6f-4c20-a82c-233fc5672766 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state None.
Aug 26 13:27:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Successfully updated port: 6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquired lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updating instance_info_cache with network_info: [{"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Releasing lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Instance network_info: |[{"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:27:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-changed-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Refreshing instance network info cache due to event network-changed-6c8499ac-a7b3-4817-af36-231c4102f096. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:27:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] Acquiring lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:27:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] Acquired lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:27:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Refreshing network info cache for port 6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:27:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:17 user nova-compute[73503]: DEBUG nova.network.neutron [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updated VIF entry in instance network info cache for port 6c8499ac-a7b3-4817-af36-231c4102f096. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:27:17 user nova-compute[73503]: DEBUG nova.network.neutron [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updating instance_info_cache with network_info: [{"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:27:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bf2a3f76-61b1-4ce2-b548-264dbb952f5f req-eee964d3-edfd-480f-a0ed-67382534eb23 service nova] Releasing lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:27:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:27:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:27:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:27:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:27:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:27:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [{"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:27:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-abc314fb-c2e8-4060-bd6f-4c8917d4e034" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:27:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:27:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:27:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.027149200439453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:27:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Creating image(s)
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Ensure instance console log exists: /opt/stack/data/nova/instances/dadd3a5c-6441-4dbb-ba1a-54bcadeccb44/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Start _get_guest_xml network_info=[{"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPuADoiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dadd3a5c-6441-4dbb-ba1a-54bcadeccb44', 'attached_at': '', 'detached_at': '', 'volume_id': '967b3c6b-66f8-4197-a9f8-de8ee96426c5', 'serial': '967b3c6b-66f8-4197-a9f8-de8ee96426c5'}, 'attachment_id': '9480751e-7415-4ba7-a399-b70eac979a41', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:27:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:27:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPuADoiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:27:25 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:27:25 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:27:25 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb6c817-c938-4813-984a-408362ae668c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:27:25 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eee3015-8664-46c1-b8ac-07de8d0d551e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5] added
Aug 26 13:27:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e533fa90-2027-4748-8a40-bbfcbfb31797]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance abc314fb-c2e8-4060-bd6f-4c8917d4e034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 90c4814c-43f2-454f-964b-6179892193c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9788cfa-058c-4897-89e1-a13b1b611051]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPuADoiI {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPuADoiI" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e234ca9f-4f60-4a68-be09-0b1f06c3af5b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPuADoiI'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1feeec-4f1f-4927-a618-5eec5969c637]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebd5b2-fc59-4e97-9cbf-dbcc37483d7f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:27:25 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:27:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:27:25 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:27:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[59664505-a9d1-46b1-a36b-7e244ea36c5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260]
Aug 26 13:27:25 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260] successful.
Aug 26 13:27:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4579b763-ec5f-42fc-9ce2-70fff29b1efa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac965885-0105-4273-98e8-6e3f4d5e9eb2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:27:26 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:27:26 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:27:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:27:26 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:27:26 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:27:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d31d7-e7a4-4c65-8839-206978033fd3]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPuADoiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:27:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.792s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23362323135313961', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362323135313961', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1183160188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1183160188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1183160188',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyFSR9jBkhPHasPe+Y1rlj+6EA9qlUH6X+HyASC0UydxolGH/UXEdt1G4I5hg6+vQfTe40GpujaS2NQXDI6ilThqQMNKUYDFCkS/2OhBuWMpdjwthAIAHt9LBYQYfLrhw==',key_name='tempest-keypair-1394029504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-w9k2pvd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122b92a79d3242f2903b15430240eace',uuid=dadd3a5c-6441-4dbb-ba1a-54bcadeccb44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'pci_devices' on Instance uuid dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:27:27 user nova-compute[73503]:   <uuid>dadd3a5c-6441-4dbb-ba1a-54bcadeccb44</uuid>
Aug 26 13:27:27 user nova-compute[73503]:   <name>instance-00000020</name>
Aug 26 13:27:27 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:27:27 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:27:27 user nova-compute[73503]:   <metadata>
Aug 26 13:27:27 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:27:27 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:27:27 user nova-compute[73503]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1183160188</nova:name>
Aug 26 13:27:27 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:27:25</nova:creationTime>
Aug 26 13:27:27 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:27:27 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:27:27 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:27:27 user nova-compute[73503]:       <nova:owner>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:user uuid="122b92a79d3242f2903b15430240eace">tempest-TestVolumeBootPattern-813053503-project-member</nova:user>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:project uuid="c56c42bf18354f55954102eed4da2d58">tempest-TestVolumeBootPattern-813053503</nova:project>
Aug 26 13:27:27 user nova-compute[73503]:       </nova:owner>
Aug 26 13:27:27 user nova-compute[73503]:       <nova:ports>
Aug 26 13:27:27 user nova-compute[73503]:         <nova:port uuid="6c8499ac-a7b3-4817-af36-231c4102f096">
Aug 26 13:27:27 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 13:27:27 user nova-compute[73503]:         </nova:port>
Aug 26 13:27:27 user nova-compute[73503]:       </nova:ports>
Aug 26 13:27:27 user nova-compute[73503]:     </nova:instance>
Aug 26 13:27:27 user nova-compute[73503]:   </metadata>
Aug 26 13:27:27 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:27:27 user nova-compute[73503]:     <system>
Aug 26 13:27:27 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:27:27 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:27:27 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:27:27 user nova-compute[73503]:       <entry name="serial">dadd3a5c-6441-4dbb-ba1a-54bcadeccb44</entry>
Aug 26 13:27:27 user nova-compute[73503]:       <entry name="uuid">dadd3a5c-6441-4dbb-ba1a-54bcadeccb44</entry>
Aug 26 13:27:27 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:27:27 user nova-compute[73503]:     </system>
Aug 26 13:27:27 user nova-compute[73503]:   </sysinfo>
Aug 26 13:27:27 user nova-compute[73503]:   <os>
Aug 26 13:27:27 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:27:27 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:27:27 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:27:27 user nova-compute[73503]:   </os>
Aug 26 13:27:27 user nova-compute[73503]:   <features>
Aug 26 13:27:27 user nova-compute[73503]:     <acpi/>
Aug 26 13:27:27 user nova-compute[73503]:     <apic/>
Aug 26 13:27:27 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:27:27 user nova-compute[73503]:   </features>
Aug 26 13:27:27 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:27:27 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:27:27 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:27:27 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:27:27 user nova-compute[73503]:   </clock>
Aug 26 13:27:27 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:27:27 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:27:27 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:27:27 user nova-compute[73503]:   </cpu>
Aug 26 13:27:27 user nova-compute[73503]:   <devices>
Aug 26 13:27:27 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:27:27 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:27:27 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:27:27 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:27:27 user nova-compute[73503]:       <serial>967b3c6b-66f8-4197-a9f8-de8ee96426c5</serial>
Aug 26 13:27:27 user nova-compute[73503]:     </disk>
Aug 26 13:27:27 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:27:27 user nova-compute[73503]:       <mac address="fa:16:3e:7e:ed:96"/>
Aug 26 13:27:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:27:27 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:27:27 user nova-compute[73503]:       <target dev="tap6c8499ac-a7"/>
Aug 26 13:27:27 user nova-compute[73503]:     </interface>
Aug 26 13:27:27 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:27:27 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/dadd3a5c-6441-4dbb-ba1a-54bcadeccb44/console.log" append="off"/>
Aug 26 13:27:27 user nova-compute[73503]:     </serial>
Aug 26 13:27:27 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:27:27 user nova-compute[73503]:     <video>
Aug 26 13:27:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:27:27 user nova-compute[73503]:     </video>
Aug 26 13:27:27 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:27:27 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:27:27 user nova-compute[73503]:     </rng>
Aug 26 13:27:27 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:27:27 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:27:27 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:27:27 user nova-compute[73503]:     </memballoon>
Aug 26 13:27:27 user nova-compute[73503]:   </devices>
Aug 26 13:27:27 user nova-compute[73503]: </domain>
Aug 26 13:27:27 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1183160188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1183160188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1183160188',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyFSR9jBkhPHasPe+Y1rlj+6EA9qlUH6X+HyASC0UydxolGH/UXEdt1G4I5hg6+vQfTe40GpujaS2NQXDI6ilThqQMNKUYDFCkS/2OhBuWMpdjwthAIAHt9LBYQYfLrhw==',key_name='tempest-keypair-1394029504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-w9k2pvd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122b92a79d3242f2903b15430240eace',uuid=dadd3a5c-6441-4dbb-ba1a-54bcadeccb44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG os_vif [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c8499ac-a7, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c8499ac-a7, col_values=(('external_ids', {'iface-id': '6c8499ac-a7b3-4817-af36-231c4102f096', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:ed:96', 'vm-uuid': 'dadd3a5c-6441-4dbb-ba1a-54bcadeccb44'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:27 user nova-compute[73503]: INFO os_vif [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7')
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No VIF found with MAC fa:16:3e:7e:ed:96, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056432.4331903, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:27:27 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Stopped (Lifecycle Event)
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1c9c69bb-4d4a-4769-ac60-40230cfe62f0 None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1c9c69bb-4d4a-4769-ac60-40230cfe62f0 None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:27:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-a9835177-9034-4bb7-b3d3-ba397225b8d5 req-bf4e40fd-783c-48dc-bebf-3c64e0a3f204 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9835177-9034-4bb7-b3d3-ba397225b8d5 req-bf4e40fd-783c-48dc-bebf-3c64e0a3f204 service nova] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9835177-9034-4bb7-b3d3-ba397225b8d5 req-bf4e40fd-783c-48dc-bebf-3c64e0a3f204 service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9835177-9034-4bb7-b3d3-ba397225b8d5 req-bf4e40fd-783c-48dc-bebf-3c64e0a3f204 service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-a9835177-9034-4bb7-b3d3-ba397225b8d5 req-bf4e40fd-783c-48dc-bebf-3c64e0a3f204 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] No waiting events found dispatching network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:28 user nova-compute[73503]: WARNING nova.compute.manager [req-a9835177-9034-4bb7-b3d3-ba397225b8d5 req-bf4e40fd-783c-48dc-bebf-3c64e0a3f204 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received unexpected event network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 for instance with vm_state building and task_state spawning.
Aug 26 13:27:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:29 user nova-compute[73503]: INFO nova.compute.manager [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Terminating instance
Aug 26 13:27:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-cf571da5-045d-4cba-a722-28889c5d604f req-d171f3f9-911a-4cfb-a197-b81279f082f4 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-unplugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cf571da5-045d-4cba-a722-28889c5d604f req-d171f3f9-911a-4cfb-a197-b81279f082f4 service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cf571da5-045d-4cba-a722-28889c5d604f req-d171f3f9-911a-4cfb-a197-b81279f082f4 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cf571da5-045d-4cba-a722-28889c5d604f req-d171f3f9-911a-4cfb-a197-b81279f082f4 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-cf571da5-045d-4cba-a722-28889c5d604f req-d171f3f9-911a-4cfb-a197-b81279f082f4 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-unplugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-cf571da5-045d-4cba-a722-28889c5d604f req-d171f3f9-911a-4cfb-a197-b81279f082f4 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-unplugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Instance destroyed successfully.
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.objects.instance [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'resources' on Instance uuid abc314fb-c2e8-4060-bd6f-4c8917d4e034 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-701153657',display_name='tempest-ServerRescueNegativeTestJSON-server-701153657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-701153657',id=3,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:13:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-1nshvrsq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:13:00Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=abc314fb-c2e8-4060-bd6f-4c8917d4e034,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "address": "fa:16:3e:bc:dc:16", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ffad0c8-4f", "ovs_interfaceid": "8ffad0c8-4fd7-465a-ba9e-f7362c167ce1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG os_vif [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ffad0c8-4f, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:30 user nova-compute[73503]: INFO os_vif [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:dc:16,bridge_name='br-int',has_traffic_filtering=True,id=8ffad0c8-4fd7-465a-ba9e-f7362c167ce1,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ffad0c8-4f')
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Deleting instance files /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034_del
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Deletion of /opt/stack/data/nova/instances/abc314fb-c2e8-4060-bd6f-4c8917d4e034_del complete
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.compute.manager [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056450.7727857, dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] VM Resumed (Lifecycle Event)
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Instance spawned successfully.
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056450.7763708, dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] VM Started (Lifecycle Event)
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-94585eec-3c19-4d94-8807-95aa37a8bf90 req-1aaa0216-7da9-46c7-a9d9-c4b53ca022e4 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-94585eec-3c19-4d94-8807-95aa37a8bf90 req-1aaa0216-7da9-46c7-a9d9-c4b53ca022e4 service nova] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-94585eec-3c19-4d94-8807-95aa37a8bf90 req-1aaa0216-7da9-46c7-a9d9-c4b53ca022e4 service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-94585eec-3c19-4d94-8807-95aa37a8bf90 req-1aaa0216-7da9-46c7-a9d9-c4b53ca022e4 service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-94585eec-3c19-4d94-8807-95aa37a8bf90 req-1aaa0216-7da9-46c7-a9d9-c4b53ca022e4 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] No waiting events found dispatching network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:30 user nova-compute[73503]: WARNING nova.compute.manager [req-94585eec-3c19-4d94-8807-95aa37a8bf90 req-1aaa0216-7da9-46c7-a9d9-c4b53ca022e4 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received unexpected event network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 for instance with vm_state building and task_state spawning.
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:27:30 user nova-compute[73503]: INFO nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:30 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:27:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Took 18.07 seconds to build instance.
Aug 26 13:27:31 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Took 0.56 seconds to deallocate network for instance.
Aug 26 13:27:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b4a02416-b6ae-4e75-a126-ee014d9016ba tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.158s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:31 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:27:31 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:27:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:31 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Deleted allocations for instance abc314fb-c2e8-4060-bd6f-4c8917d4e034
Aug 26 13:27:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-33c2777d-5f9c-4884-ae72-30352b98e517 tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] Acquiring lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] Lock "abc314fb-c2e8-4060-bd6f-4c8917d4e034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] No waiting events found dispatching network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:32 user nova-compute[73503]: WARNING nova.compute.manager [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received unexpected event network-vif-plugged-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 for instance with vm_state deleted and task_state None.
Aug 26 13:27:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-890c442e-3bcf-4c9f-b27b-b6a1ee857a7c req-66d6dca0-ce18-4184-9052-bb7cb8b41570 service nova] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Received event network-vif-deleted-8ffad0c8-4fd7-465a-ba9e-f7362c167ce1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:33 user nova-compute[73503]: INFO nova.compute.manager [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Terminating instance
Aug 26 13:27:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-27478080-8237-43c2-b989-d545ad38db06 req-7654f60f-fc3b-4276-92a0-31f848ad74fc service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-vif-unplugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-27478080-8237-43c2-b989-d545ad38db06 req-7654f60f-fc3b-4276-92a0-31f848ad74fc service nova] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-27478080-8237-43c2-b989-d545ad38db06 req-7654f60f-fc3b-4276-92a0-31f848ad74fc service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-27478080-8237-43c2-b989-d545ad38db06 req-7654f60f-fc3b-4276-92a0-31f848ad74fc service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-27478080-8237-43c2-b989-d545ad38db06 req-7654f60f-fc3b-4276-92a0-31f848ad74fc service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] No waiting events found dispatching network-vif-unplugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-27478080-8237-43c2-b989-d545ad38db06 req-7654f60f-fc3b-4276-92a0-31f848ad74fc service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-vif-unplugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:27:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Instance destroyed successfully.
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'resources' on Instance uuid 90c4814c-43f2-454f-964b-6179892193c1 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1763346596',display_name='tempest-AttachVolumeNegativeTest-server-1763346596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1763346596',id=24,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQgB2/40Fk1VB+VvWu/sRsB5M7HTgeHby31o019bfTMFKGSz4898YrQt1tYbDxhkjlVP/rDcAu8KeqCEp1Kb7PaLGSrqbbSrsEphGGOTivVL2gn+xMRIFSQtZ0u3CAq0w==',key_name='tempest-keypair-1931940153',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-uv0yxtig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=90c4814c-43f2-454f-964b-6179892193c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "address": "fa:16:3e:0a:01:0d", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01caaa96-2f", "ovs_interfaceid": "01caaa96-2fd2-4f7b-9089-29ba2c607ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG os_vif [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01caaa96-2f, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:34 user nova-compute[73503]: INFO os_vif [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:01:0d,bridge_name='br-int',has_traffic_filtering=True,id=01caaa96-2fd2-4f7b-9089-29ba2c607ff1,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01caaa96-2f')
Aug 26 13:27:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Deleting instance files /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1_del
Aug 26 13:27:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Deletion of /opt/stack/data/nova/instances/90c4814c-43f2-454f-964b-6179892193c1_del complete
Aug 26 13:27:34 user nova-compute[73503]: INFO nova.compute.manager [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 13:27:34 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:27:34 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:27:35 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:27:35 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Took 0.84 seconds to deallocate network for instance.
Aug 26 13:27:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:35 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:27:35 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:27:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:35 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Deleted allocations for instance 90c4814c-43f2-454f-964b-6179892193c1
Aug 26 13:27:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8f140a2d-e994-4980-96e2-e923c6d17d3e tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "90c4814c-43f2-454f-964b-6179892193c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] Acquiring lock "90c4814c-43f2-454f-964b-6179892193c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] Lock "90c4814c-43f2-454f-964b-6179892193c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] No waiting events found dispatching network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:27:36 user nova-compute[73503]: WARNING nova.compute.manager [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received unexpected event network-vif-plugged-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 for instance with vm_state deleted and task_state None.
Aug 26 13:27:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-b2d0ca76-9992-43ac-8f7b-f61d6d865a7c req-0ad5c908-eabd-413f-9b7d-8cc8520db501 service nova] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Received event network-vif-deleted-01caaa96-2fd2-4f7b-9089-29ba2c607ff1 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:27:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_power_states {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 7bf15cad-4bbf-4d7f-b811-7cf79758e1af {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 45a45e79-86a3-40a8-96bc-7437cf769580 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid ac1098c8-c3d6-4f13-9093-3a4100e41299 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid d0fab249-2251-46e5-8b6e-83df64db1cf2 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "45a45e79-86a3-40a8-96bc-7437cf769580" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "45a45e79-86a3-40a8-96bc-7437cf769580" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:27:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:27:45 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056450.323776, abc314fb-c2e8-4060-bd6f-4c8917d4e034 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:27:45 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] VM Stopped (Lifecycle Event)
Aug 26 13:27:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8f53b267-466f-4e5c-97a3-5791387f4ce7 None None] [instance: abc314fb-c2e8-4060-bd6f-4c8917d4e034] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:49 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056454.3557637, 90c4814c-43f2-454f-964b-6179892193c1 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:27:49 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 90c4814c-43f2-454f-964b-6179892193c1] VM Stopped (Lifecycle Event)
Aug 26 13:27:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-710f0045-f94d-41b3-97da-842a5f845c1a None None] [instance: 90c4814c-43f2-454f-964b-6179892193c1] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:27:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:57 user nova-compute[73503]: INFO nova.compute.manager [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] instance snapshotting
Aug 26 13:27:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Beginning live snapshot process
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpai0_682o/215fb82e1aba4922847da03cd2fb53ce.delta 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:27:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpai0_682o/215fb82e1aba4922847da03cd2fb53ce.delta 1073741824" returned: 0 in 0.053s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:27:58 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 13:27:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:27:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:28:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] COPY block job progress, current cursor: 75431936 final cursor: 75497472 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:28:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:28:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 13:28:00 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:28:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpai0_682o/215fb82e1aba4922847da03cd2fb53ce.delta /opt/stack/data/nova/instances/snapshots/tmpai0_682o/215fb82e1aba4922847da03cd2fb53ce {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpai0_682o/215fb82e1aba4922847da03cd2fb53ce.delta /opt/stack/data/nova/instances/snapshots/tmpai0_682o/215fb82e1aba4922847da03cd2fb53ce" returned: 0 in 0.556s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Snapshot extracted, beginning image upload
Aug 26 13:28:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Snapshot image upload complete
Aug 26 13:28:03 user nova-compute[73503]: INFO nova.compute.manager [None req-c43f43b2-0a47-4831-a01a-1c444e89cea8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Took 5.88 seconds to snapshot the instance on the hypervisor.
Aug 26 13:28:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:28:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:28:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:28:15 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:20 user nova-compute[73503]: INFO nova.compute.manager [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Terminating instance
Aug 26 13:28:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-98ebc33a-9054-40a3-8f43-d3bbf59ba977 req-1cf942c5-f48d-43a7-8e11-e8de2d24309a service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-98ebc33a-9054-40a3-8f43-d3bbf59ba977 req-1cf942c5-f48d-43a7-8e11-e8de2d24309a service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-98ebc33a-9054-40a3-8f43-d3bbf59ba977 req-1cf942c5-f48d-43a7-8e11-e8de2d24309a service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-98ebc33a-9054-40a3-8f43-d3bbf59ba977 req-1cf942c5-f48d-43a7-8e11-e8de2d24309a service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-98ebc33a-9054-40a3-8f43-d3bbf59ba977 req-1cf942c5-f48d-43a7-8e11-e8de2d24309a service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-98ebc33a-9054-40a3-8f43-d3bbf59ba977 req-1cf942c5-f48d-43a7-8e11-e8de2d24309a service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-unplugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:28:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Instance destroyed successfully.
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lazy-loading 'resources' on Instance uuid 9a0a305a-0375-41a9-9b51-a78d65270f43 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1745673538',display_name='tempest-ServerRescueNegativeTestJSON-server-1745673538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1745673538',id=1,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:15:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84b5b1338f040709bafbe65939ac8e7',ramdisk_id='',reservation_id='r-h9pms00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-993610223',owner_user_name='tempest-ServerRescueNegativeTestJSON-993610223-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:17:52Z,user_data=None,user_id='9cd5b0cb95ba4c6984a9fe5085c87207',uuid=9a0a305a-0375-41a9-9b51-a78d65270f43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converting VIF {"id": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "address": "fa:16:3e:f2:14:2b", "network": {"id": "4c1b9990-2d37-4a61-ab23-8d30c4a46f41", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-549253593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a84b5b1338f040709bafbe65939ac8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4622b1e-a6", "ovs_interfaceid": "d4622b1e-a61d-4f3f-9d72-cec555ea6131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG os_vif [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4622b1e-a6, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:21 user nova-compute[73503]: INFO os_vif [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:14:2b,bridge_name='br-int',has_traffic_filtering=True,id=d4622b1e-a61d-4f3f-9d72-cec555ea6131,network=Network(4c1b9990-2d37-4a61-ab23-8d30c4a46f41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4622b1e-a6')
Aug 26 13:28:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Deleting instance files /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43_del
Aug 26 13:28:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Deletion of /opt/stack/data/nova/instances/9a0a305a-0375-41a9-9b51-a78d65270f43_del complete
Aug 26 13:28:21 user nova-compute[73503]: INFO nova.compute.manager [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 13:28:21 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [{"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-7bf15cad-4bbf-4d7f-b811-7cf79758e1af" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:23 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Took 1.41 seconds to deallocate network for instance.
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-6550fd64-71a9-45e4-8a9c-1169cc814e03 req-daee4a1f-d615-4a6e-9ad0-9b4ac05e911e service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-deleted-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:23 user nova-compute[73503]: INFO nova.compute.manager [req-6550fd64-71a9-45e4-8a9c-1169cc814e03 req-daee4a1f-d615-4a6e-9ad0-9b4ac05e911e service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Neutron deleted interface d4622b1e-a61d-4f3f-9d72-cec555ea6131; detaching it from the instance and deleting it from the info cache
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.network.neutron [req-6550fd64-71a9-45e4-8a9c-1169cc814e03 req-daee4a1f-d615-4a6e-9ad0-9b4ac05e911e service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-6550fd64-71a9-45e4-8a9c-1169cc814e03 req-daee4a1f-d615-4a6e-9ad0-9b4ac05e911e service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Detach interface failed, port_id=d4622b1e-a61d-4f3f-9d72-cec555ea6131, reason: Instance 9a0a305a-0375-41a9-9b51-a78d65270f43 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-dccd32b2-136a-46e7-9d62-1876be9763a1 req-07c6dc56-47ab-4433-964b-8df57d9a1246 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dccd32b2-136a-46e7-9d62-1876be9763a1 req-07c6dc56-47ab-4433-964b-8df57d9a1246 service nova] Acquiring lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dccd32b2-136a-46e7-9d62-1876be9763a1 req-07c6dc56-47ab-4433-964b-8df57d9a1246 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dccd32b2-136a-46e7-9d62-1876be9763a1 req-07c6dc56-47ab-4433-964b-8df57d9a1246 service nova] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-dccd32b2-136a-46e7-9d62-1876be9763a1 req-07c6dc56-47ab-4433-964b-8df57d9a1246 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] No waiting events found dispatching network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:23 user nova-compute[73503]: WARNING nova.compute.manager [req-dccd32b2-136a-46e7-9d62-1876be9763a1 req-07c6dc56-47ab-4433-964b-8df57d9a1246 service nova] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Received unexpected event network-vif-plugged-d4622b1e-a61d-4f3f-9d72-cec555ea6131 for instance with vm_state deleted and task_state None.
Aug 26 13:28:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:23 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Deleted allocations for instance 9a0a305a-0375-41a9-9b51-a78d65270f43
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e4bf6442-2976-4fed-8dc7-24450d8e450f tempest-ServerRescueNegativeTestJSON-993610223 tempest-ServerRescueNegativeTestJSON-993610223-project-member] Lock "9a0a305a-0375-41a9-9b51-a78d65270f43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:28:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:25 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7969MB free_disk=25.050979614257812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:28:25 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:28:26 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:28:26 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:28:26 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:28:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:28:27 user nova-compute[73503]: INFO nova.compute.claims [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Claim successful on node user
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.network.neutron [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:28:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:28:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.policy [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8239f95979394225b8c80579a8121631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e80f2c62e0a4494816b02e60073bb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:28:28 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Creating image(s)
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk 1073741824" returned: 0 in 0.062s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.network.neutron [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Successfully created port: 1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.229s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Cannot resize image /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Ensure instance console log exists: /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Successfully updated port: 1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquired lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-changed-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Refreshing instance network info cache due to event network-changed-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] Acquiring lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updating instance_info_cache with network_info: [{"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Releasing lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Instance network_info: |[{"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] Acquired lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.network.neutron [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Refreshing network info cache for port 1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Start _get_guest_xml network_info=[{"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:28:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:28:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-233459650',display_name='tempest-AttachVolumeNegativeTest-server-233459650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-233459650',id=33,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8NNE2FfakW8ibWsS4kqPX8wwIJ+/l+gt6zuvh4oo9G9bxdyZKNs4ZOTmvGbaaMUrVto0xYVH5h2tG+S0YwsPzdCT2dWzfMwv3JQBENpGpsiDJQwNvfWWPmQ18lC4Tcag==',key_name='tempest-keypair-1389709946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-n0c5rzbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=2fc449d6-4fa3-4de4-aba2-4562b1db674e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.objects.instance [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fc449d6-4fa3-4de4-aba2-4562b1db674e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:28:30 user nova-compute[73503]:   <uuid>2fc449d6-4fa3-4de4-aba2-4562b1db674e</uuid>
Aug 26 13:28:30 user nova-compute[73503]:   <name>instance-00000021</name>
Aug 26 13:28:30 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:28:30 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:28:30 user nova-compute[73503]:   <metadata>
Aug 26 13:28:30 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:28:30 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:28:30 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeNegativeTest-server-233459650</nova:name>
Aug 26 13:28:30 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:28:29</nova:creationTime>
Aug 26 13:28:30 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:28:30 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:28:30 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:28:30 user nova-compute[73503]:       <nova:owner>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:user uuid="8239f95979394225b8c80579a8121631">tempest-AttachVolumeNegativeTest-2059589668-project-member</nova:user>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:project uuid="3e80f2c62e0a4494816b02e60073bb0e">tempest-AttachVolumeNegativeTest-2059589668</nova:project>
Aug 26 13:28:30 user nova-compute[73503]:       </nova:owner>
Aug 26 13:28:30 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:28:30 user nova-compute[73503]:       <nova:ports>
Aug 26 13:28:30 user nova-compute[73503]:         <nova:port uuid="1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d">
Aug 26 13:28:30 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 13:28:30 user nova-compute[73503]:         </nova:port>
Aug 26 13:28:30 user nova-compute[73503]:       </nova:ports>
Aug 26 13:28:30 user nova-compute[73503]:     </nova:instance>
Aug 26 13:28:30 user nova-compute[73503]:   </metadata>
Aug 26 13:28:30 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:28:30 user nova-compute[73503]:     <system>
Aug 26 13:28:30 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:28:30 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:28:30 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:28:30 user nova-compute[73503]:       <entry name="serial">2fc449d6-4fa3-4de4-aba2-4562b1db674e</entry>
Aug 26 13:28:30 user nova-compute[73503]:       <entry name="uuid">2fc449d6-4fa3-4de4-aba2-4562b1db674e</entry>
Aug 26 13:28:30 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:28:30 user nova-compute[73503]:     </system>
Aug 26 13:28:30 user nova-compute[73503]:   </sysinfo>
Aug 26 13:28:30 user nova-compute[73503]:   <os>
Aug 26 13:28:30 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:28:30 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:28:30 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:28:30 user nova-compute[73503]:   </os>
Aug 26 13:28:30 user nova-compute[73503]:   <features>
Aug 26 13:28:30 user nova-compute[73503]:     <acpi/>
Aug 26 13:28:30 user nova-compute[73503]:     <apic/>
Aug 26 13:28:30 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:28:30 user nova-compute[73503]:   </features>
Aug 26 13:28:30 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:28:30 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:28:30 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:28:30 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:28:30 user nova-compute[73503]:   </clock>
Aug 26 13:28:30 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:28:30 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:28:30 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:28:30 user nova-compute[73503]:   </cpu>
Aug 26 13:28:30 user nova-compute[73503]:   <devices>
Aug 26 13:28:30 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:28:30 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:28:30 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk"/>
Aug 26 13:28:30 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:28:30 user nova-compute[73503]:     </disk>
Aug 26 13:28:30 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:28:30 user nova-compute[73503]:       <mac address="fa:16:3e:00:bc:e7"/>
Aug 26 13:28:30 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:28:30 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:28:30 user nova-compute[73503]:       <target dev="tap1ff42c67-34"/>
Aug 26 13:28:30 user nova-compute[73503]:     </interface>
Aug 26 13:28:30 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:28:30 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/console.log" append="off"/>
Aug 26 13:28:30 user nova-compute[73503]:     </serial>
Aug 26 13:28:30 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:28:30 user nova-compute[73503]:     <video>
Aug 26 13:28:30 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:28:30 user nova-compute[73503]:     </video>
Aug 26 13:28:30 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:28:30 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:28:30 user nova-compute[73503]:     </rng>
Aug 26 13:28:30 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:28:30 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:28:30 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:28:30 user nova-compute[73503]:     </memballoon>
Aug 26 13:28:30 user nova-compute[73503]:   </devices>
Aug 26 13:28:30 user nova-compute[73503]: </domain>
Aug 26 13:28:30 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-233459650',display_name='tempest-AttachVolumeNegativeTest-server-233459650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-233459650',id=33,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8NNE2FfakW8ibWsS4kqPX8wwIJ+/l+gt6zuvh4oo9G9bxdyZKNs4ZOTmvGbaaMUrVto0xYVH5h2tG+S0YwsPzdCT2dWzfMwv3JQBENpGpsiDJQwNvfWWPmQ18lC4Tcag==',key_name='tempest-keypair-1389709946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-n0c5rzbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=2fc449d6-4fa3-4de4-aba2-4562b1db674e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG os_vif [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ff42c67-34, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ff42c67-34, col_values=(('external_ids', {'iface-id': '1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:bc:e7', 'vm-uuid': '2fc449d6-4fa3-4de4-aba2-4562b1db674e'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:30 user nova-compute[73503]: INFO os_vif [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34')
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:00:bc:e7, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.network.neutron [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updated VIF entry in instance network info cache for port 1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG nova.network.neutron [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updating instance_info_cache with network_info: [{"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c49a5c12-59e9-43f4-ac05-9a4a7a8ccab8 req-e4d67251-4f97-43f4-871c-6836a0792848 service nova] Releasing lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:31 user nova-compute[73503]: INFO nova.compute.manager [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Unshelving
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'pci_requests' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'numa_topology' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:28:31 user nova-compute[73503]: INFO nova.compute.claims [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Claim successful on node user
Aug 26 13:28:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:31 user nova-compute[73503]: INFO nova.network.neutron [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating port 038813f4-35c2-4b75-9de1-f2bc3df33fe0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-2d9977ed-75cf-4046-9806-30a579f47877 req-80b48c43-6d92-4b5f-9ea9-53bc96c143a2 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2d9977ed-75cf-4046-9806-30a579f47877 req-80b48c43-6d92-4b5f-9ea9-53bc96c143a2 service nova] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2d9977ed-75cf-4046-9806-30a579f47877 req-80b48c43-6d92-4b5f-9ea9-53bc96c143a2 service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2d9977ed-75cf-4046-9806-30a579f47877 req-80b48c43-6d92-4b5f-9ea9-53bc96c143a2 service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-2d9977ed-75cf-4046-9806-30a579f47877 req-80b48c43-6d92-4b5f-9ea9-53bc96c143a2 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] No waiting events found dispatching network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:31 user nova-compute[73503]: WARNING nova.compute.manager [req-2d9977ed-75cf-4046-9806-30a579f47877 req-80b48c43-6d92-4b5f-9ea9-53bc96c143a2 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received unexpected event network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d for instance with vm_state building and task_state spawning.
Aug 26 13:28:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:28:33 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Creating image(s)
Aug 26 13:28:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG nova.objects.base [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "d27692b25bc8bafa89e7440d23a73ef19893e73e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "d27692b25bc8bafa89e7440d23a73ef19893e73e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056513.8136322, 2fc449d6-4fa3-4de4-aba2-4562b1db674e => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] VM Resumed (Lifecycle Event)
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] No waiting events found dispatching network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:34 user nova-compute[73503]: WARNING nova.compute.manager [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received unexpected event network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d for instance with vm_state building and task_state spawning.
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing instance network info cache due to event network-changed-038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] Acquiring lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] Acquired lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.network.neutron [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Refreshing network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Instance spawned successfully.
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056513.814971, 2fc449d6-4fa3-4de4-aba2-4562b1db674e => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] VM Started (Lifecycle Event)
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.part --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.virt.images [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] 585a6f82-50b0-4727-b351-d772978deb32 was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.part /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:34 user nova-compute[73503]: INFO nova.compute.manager [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Took 7.38 seconds to build instance.
Aug 26 13:28:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-155a8e1f-0e6a-42a3-9187-93d04f0967b2 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.514s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.part /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.converted" returned: 0 in 0.448s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updated VIF entry in instance network info cache for port 038813f4-35c2-4b75-9de1-f2bc3df33fe0. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-83c5be4f-d0f5-4bb6-98b5-61ef83a4d02c req-16a8d5f7-26c2-4259-b413-1341045300bc service nova] Releasing lock "refresh_cache-9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "d27692b25bc8bafa89e7440d23a73ef19893e73e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.017s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "d27692b25bc8bafa89e7440d23a73ef19893e73e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "d27692b25bc8bafa89e7440d23a73ef19893e73e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e,backing_fmt=raw /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e,backing_fmt=raw /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk 1073741824" returned: 0 in 0.056s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "d27692b25bc8bafa89e7440d23a73ef19893e73e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:36 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'migration_context' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:36 user nova-compute[73503]: DEBUG nova.objects.base [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:28:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Rebasing disk image.
Aug 26 13:28:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b -F raw /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:36 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056501.5035162, 9a0a305a-0375-41a9-9b51-a78d65270f43 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:36 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] VM Stopped (Lifecycle Event)
Aug 26 13:28:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-559b43b1-b9f4-474e-b37d-8ec8ba50b4c3 None None] [instance: 9a0a305a-0375-41a9-9b51-a78d65270f43] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b -F raw /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk" returned: 0 in 1.948s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Start _get_guest_xml network_info=[{"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c21583b808683786b3673a4190d8fc7d',container_format='bare',created_at=2023-08-26T13:26:38Z,direct_url=<?>,disk_format='qcow2',id=585a6f82-50b0-4727-b351-d772978deb32,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-523018557-shelved',owner='b92392a06d1e41d49af47410121fabc0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T13:26:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:28:38 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:38 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c21583b808683786b3673a4190d8fc7d',container_format='bare',created_at=2023-08-26T13:26:38Z,direct_url=<?>,disk_format='qcow2',id=585a6f82-50b0-4727-b351-d772978deb32,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-523018557-shelved',owner='b92392a06d1e41d49af47410121fabc0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T13:26:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.objects.base [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523018557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523018557',id=30,image_ref='585a6f82-50b0-4727-b351-d772978deb32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1858926900',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:24:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-9bgjnz2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member',shelved_at='2023-08-26T13:26:42.650408',shelved_host='user',shelved_image_id='585a6f82-50b0-4727-b351-d772978deb32'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.objects.base [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Object Instance<9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:28:38 user nova-compute[73503]:   <uuid>9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02</uuid>
Aug 26 13:28:38 user nova-compute[73503]:   <name>instance-0000001e</name>
Aug 26 13:28:38 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:28:38 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:28:38 user nova-compute[73503]:   <metadata>
Aug 26 13:28:38 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:28:38 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:28:38 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-523018557</nova:name>
Aug 26 13:28:38 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:28:38</nova:creationTime>
Aug 26 13:28:38 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:28:38 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:28:38 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:28:38 user nova-compute[73503]:       <nova:owner>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:user uuid="ad99f2e83e814a07a9f41d00b6bcecde">tempest-AttachVolumeShelveTestJSON-568979141-project-member</nova:user>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:project uuid="b92392a06d1e41d49af47410121fabc0">tempest-AttachVolumeShelveTestJSON-568979141</nova:project>
Aug 26 13:28:38 user nova-compute[73503]:       </nova:owner>
Aug 26 13:28:38 user nova-compute[73503]:       <nova:root type="image" uuid="585a6f82-50b0-4727-b351-d772978deb32"/>
Aug 26 13:28:38 user nova-compute[73503]:       <nova:ports>
Aug 26 13:28:38 user nova-compute[73503]:         <nova:port uuid="038813f4-35c2-4b75-9de1-f2bc3df33fe0">
Aug 26 13:28:38 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:28:38 user nova-compute[73503]:         </nova:port>
Aug 26 13:28:38 user nova-compute[73503]:       </nova:ports>
Aug 26 13:28:38 user nova-compute[73503]:     </nova:instance>
Aug 26 13:28:38 user nova-compute[73503]:   </metadata>
Aug 26 13:28:38 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:28:38 user nova-compute[73503]:     <system>
Aug 26 13:28:38 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:28:38 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:28:38 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:28:38 user nova-compute[73503]:       <entry name="serial">9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02</entry>
Aug 26 13:28:38 user nova-compute[73503]:       <entry name="uuid">9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02</entry>
Aug 26 13:28:38 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:28:38 user nova-compute[73503]:     </system>
Aug 26 13:28:38 user nova-compute[73503]:   </sysinfo>
Aug 26 13:28:38 user nova-compute[73503]:   <os>
Aug 26 13:28:38 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:28:38 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:28:38 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:28:38 user nova-compute[73503]:   </os>
Aug 26 13:28:38 user nova-compute[73503]:   <features>
Aug 26 13:28:38 user nova-compute[73503]:     <acpi/>
Aug 26 13:28:38 user nova-compute[73503]:     <apic/>
Aug 26 13:28:38 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:28:38 user nova-compute[73503]:   </features>
Aug 26 13:28:38 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:28:38 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:28:38 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:28:38 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:28:38 user nova-compute[73503]:   </clock>
Aug 26 13:28:38 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:28:38 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:28:38 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:28:38 user nova-compute[73503]:   </cpu>
Aug 26 13:28:38 user nova-compute[73503]:   <devices>
Aug 26 13:28:38 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:28:38 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:28:38 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk"/>
Aug 26 13:28:38 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:28:38 user nova-compute[73503]:     </disk>
Aug 26 13:28:38 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:28:38 user nova-compute[73503]:       <mac address="fa:16:3e:77:6d:4b"/>
Aug 26 13:28:38 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:28:38 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:28:38 user nova-compute[73503]:       <target dev="tap038813f4-35"/>
Aug 26 13:28:38 user nova-compute[73503]:     </interface>
Aug 26 13:28:38 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:28:38 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/console.log" append="off"/>
Aug 26 13:28:38 user nova-compute[73503]:     </serial>
Aug 26 13:28:38 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:28:38 user nova-compute[73503]:     <video>
Aug 26 13:28:38 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:28:38 user nova-compute[73503]:     </video>
Aug 26 13:28:38 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:28:38 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:28:38 user nova-compute[73503]:     </rng>
Aug 26 13:28:38 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:28:38 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:28:38 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:28:38 user nova-compute[73503]:     </memballoon>
Aug 26 13:28:38 user nova-compute[73503]:   </devices>
Aug 26 13:28:38 user nova-compute[73503]: </domain>
Aug 26 13:28:38 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523018557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523018557',id=30,image_ref='585a6f82-50b0-4727-b351-d772978deb32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1858926900',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:24:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-9bgjnz2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member',shelved_at='2023-08-26T13:26:42.650408',shelved_host='user',shelved_image_id='585a6f82-50b0-4727-b351-d772978deb32'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG os_vif [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038813f4-35, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap038813f4-35, col_values=(('external_ids', {'iface-id': '038813f4-35c2-4b75-9de1-f2bc3df33fe0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:6d:4b', 'vm-uuid': '9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:38 user nova-compute[73503]: INFO os_vif [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35')
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:28:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] No VIF found with MAC fa:16:3e:77:6d:4b, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-66b98449-cf5b-4687-a854-2e7387ce5bac req-ead49f58-886b-4f36-a9bd-75ddc108b5b5 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-66b98449-cf5b-4687-a854-2e7387ce5bac req-ead49f58-886b-4f36-a9bd-75ddc108b5b5 service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-66b98449-cf5b-4687-a854-2e7387ce5bac req-ead49f58-886b-4f36-a9bd-75ddc108b5b5 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-66b98449-cf5b-4687-a854-2e7387ce5bac req-ead49f58-886b-4f36-a9bd-75ddc108b5b5 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-66b98449-cf5b-4687-a854-2e7387ce5bac req-ead49f58-886b-4f36-a9bd-75ddc108b5b5 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:40 user nova-compute[73503]: WARNING nova.compute.manager [req-66b98449-cf5b-4687-a854-2e7387ce5bac req-ead49f58-886b-4f36-a9bd-75ddc108b5b5 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056522.3438916, 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] VM Resumed (Lifecycle Event)
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:28:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance spawned successfully.
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:28:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056522.3480625, 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] VM Started (Lifecycle Event)
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:28:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-44a94340-9fd6-4227-8d02-ae3c71cd1d98 req-b2d326a7-2eb7-4890-9477-060c5c07da84 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-44a94340-9fd6-4227-8d02-ae3c71cd1d98 req-b2d326a7-2eb7-4890-9477-060c5c07da84 service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-44a94340-9fd6-4227-8d02-ae3c71cd1d98 req-b2d326a7-2eb7-4890-9477-060c5c07da84 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-44a94340-9fd6-4227-8d02-ae3c71cd1d98 req-b2d326a7-2eb7-4890-9477-060c5c07da84 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-44a94340-9fd6-4227-8d02-ae3c71cd1d98 req-b2d326a7-2eb7-4890-9477-060c5c07da84 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:42 user nova-compute[73503]: WARNING nova.compute.manager [req-44a94340-9fd6-4227-8d02-ae3c71cd1d98 req-b2d326a7-2eb7-4890-9477-060c5c07da84 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 13:28:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ce91246-b1ec-402d-ad36-4f6358ef77b6 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.759s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:44 user nova-compute[73503]: INFO nova.compute.manager [None req-a7ed0a3d-d4f6-4987-ac18-56d62f090661 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Get console output
Aug 26 13:28:45 user nova-compute[73503]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 13:28:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "69202d93-711c-483d-9139-259980900b76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "69202d93-711c-483d-9139-259980900b76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:28:53 user nova-compute[73503]: INFO nova.compute.claims [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Claim successful on node user
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:28:53 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.policy [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45fe9e01c207444aa5480a6e4ddd480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4528507d2e6a4599b81db97d0f3bc0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:28:53 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Creating image(s)
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "/opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "/opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "/opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.209s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.227s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Successfully created port: c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk 1073741824" returned: 0 in 0.051s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Cannot resize image /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Ensure instance console log exists: /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Successfully updated port: c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "refresh_cache-69202d93-711c-483d-9139-259980900b76" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquired lock "refresh_cache-69202d93-711c-483d-9139-259980900b76" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-changed-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Refreshing instance network info cache due to event network-changed-c422cece-c137-4510-af35-8545e93757e2. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] Acquiring lock "refresh_cache-69202d93-711c-483d-9139-259980900b76" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Updating instance_info_cache with network_info: [{"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Releasing lock "refresh_cache-69202d93-711c-483d-9139-259980900b76" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Instance network_info: |[{"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] Acquired lock "refresh_cache-69202d93-711c-483d-9139-259980900b76" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Refreshing network info cache for port c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Start _get_guest_xml network_info=[{"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:28:55 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:55 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-609030607',display_name='tempest-VolumesActionsTest-instance-609030607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-609030607',id=34,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4528507d2e6a4599b81db97d0f3bc0b0',ramdisk_id='',reservation_id='r-xdb67tcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2093075288',owner_user_name='tempest-VolumesActionsTest-2093075288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:28:54Z,user_data=None,user_id='45fe9e01c207444aa5480a6e4ddd480a',uuid=69202d93-711c-483d-9139-259980900b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converting VIF {"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lazy-loading 'pci_devices' on Instance uuid 69202d93-711c-483d-9139-259980900b76 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:28:55 user nova-compute[73503]:   <uuid>69202d93-711c-483d-9139-259980900b76</uuid>
Aug 26 13:28:55 user nova-compute[73503]:   <name>instance-00000022</name>
Aug 26 13:28:55 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:28:55 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:28:55 user nova-compute[73503]:   <metadata>
Aug 26 13:28:55 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:28:55 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:28:55 user nova-compute[73503]:       <nova:name>tempest-VolumesActionsTest-instance-609030607</nova:name>
Aug 26 13:28:55 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:28:55</nova:creationTime>
Aug 26 13:28:55 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:28:55 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:28:55 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:28:55 user nova-compute[73503]:       <nova:owner>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:user uuid="45fe9e01c207444aa5480a6e4ddd480a">tempest-VolumesActionsTest-2093075288-project-member</nova:user>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:project uuid="4528507d2e6a4599b81db97d0f3bc0b0">tempest-VolumesActionsTest-2093075288</nova:project>
Aug 26 13:28:55 user nova-compute[73503]:       </nova:owner>
Aug 26 13:28:55 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:28:55 user nova-compute[73503]:       <nova:ports>
Aug 26 13:28:55 user nova-compute[73503]:         <nova:port uuid="c422cece-c137-4510-af35-8545e93757e2">
Aug 26 13:28:55 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:28:55 user nova-compute[73503]:         </nova:port>
Aug 26 13:28:55 user nova-compute[73503]:       </nova:ports>
Aug 26 13:28:55 user nova-compute[73503]:     </nova:instance>
Aug 26 13:28:55 user nova-compute[73503]:   </metadata>
Aug 26 13:28:55 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:28:55 user nova-compute[73503]:     <system>
Aug 26 13:28:55 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:28:55 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:28:55 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:28:55 user nova-compute[73503]:       <entry name="serial">69202d93-711c-483d-9139-259980900b76</entry>
Aug 26 13:28:55 user nova-compute[73503]:       <entry name="uuid">69202d93-711c-483d-9139-259980900b76</entry>
Aug 26 13:28:55 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:28:55 user nova-compute[73503]:     </system>
Aug 26 13:28:55 user nova-compute[73503]:   </sysinfo>
Aug 26 13:28:55 user nova-compute[73503]:   <os>
Aug 26 13:28:55 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:28:55 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:28:55 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:28:55 user nova-compute[73503]:   </os>
Aug 26 13:28:55 user nova-compute[73503]:   <features>
Aug 26 13:28:55 user nova-compute[73503]:     <acpi/>
Aug 26 13:28:55 user nova-compute[73503]:     <apic/>
Aug 26 13:28:55 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:28:55 user nova-compute[73503]:   </features>
Aug 26 13:28:55 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:28:55 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:28:55 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:28:55 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:28:55 user nova-compute[73503]:   </clock>
Aug 26 13:28:55 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:28:55 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:28:55 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:28:55 user nova-compute[73503]:   </cpu>
Aug 26 13:28:55 user nova-compute[73503]:   <devices>
Aug 26 13:28:55 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:28:55 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:28:55 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk"/>
Aug 26 13:28:55 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:28:55 user nova-compute[73503]:     </disk>
Aug 26 13:28:55 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:28:55 user nova-compute[73503]:       <mac address="fa:16:3e:a5:35:59"/>
Aug 26 13:28:55 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:28:55 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:28:55 user nova-compute[73503]:       <target dev="tapc422cece-c1"/>
Aug 26 13:28:55 user nova-compute[73503]:     </interface>
Aug 26 13:28:55 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:28:55 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/console.log" append="off"/>
Aug 26 13:28:55 user nova-compute[73503]:     </serial>
Aug 26 13:28:55 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:28:55 user nova-compute[73503]:     <video>
Aug 26 13:28:55 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:28:55 user nova-compute[73503]:     </video>
Aug 26 13:28:55 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:28:55 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:28:55 user nova-compute[73503]:     </rng>
Aug 26 13:28:55 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:28:55 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:28:55 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:28:55 user nova-compute[73503]:     </memballoon>
Aug 26 13:28:55 user nova-compute[73503]:   </devices>
Aug 26 13:28:55 user nova-compute[73503]: </domain>
Aug 26 13:28:55 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-609030607',display_name='tempest-VolumesActionsTest-instance-609030607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-609030607',id=34,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4528507d2e6a4599b81db97d0f3bc0b0',ramdisk_id='',reservation_id='r-xdb67tcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2093075288',owner_user_name='tempest-VolumesActionsTest-2093075288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:28:54Z,user_data=None,user_id='45fe9e01c207444aa5480a6e4ddd480a',uuid=69202d93-711c-483d-9139-259980900b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converting VIF {"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG os_vif [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc422cece-c1, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc422cece-c1, col_values=(('external_ids', {'iface-id': 'c422cece-c137-4510-af35-8545e93757e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:35:59', 'vm-uuid': '69202d93-711c-483d-9139-259980900b76'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:55 user nova-compute[73503]: INFO os_vif [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1')
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] No VIF found with MAC fa:16:3e:a5:35:59, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Updated VIF entry in instance network info cache for port c422cece-c137-4510-af35-8545e93757e2. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Updating instance_info_cache with network_info: [{"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:28:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-09d6a5d6-d721-4637-a40d-a2df3a2f3633 req-d5076e99-b2b5-4b3f-bbf2-7a0707fef0ed service nova] Releasing lock "refresh_cache-69202d93-711c-483d-9139-259980900b76" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:28:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-a5e53c42-5347-40ac-a958-ae934e6be897 req-c3868944-8460-4331-a981-9351079597cc service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a5e53c42-5347-40ac-a958-ae934e6be897 req-c3868944-8460-4331-a981-9351079597cc service nova] Acquiring lock "69202d93-711c-483d-9139-259980900b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a5e53c42-5347-40ac-a958-ae934e6be897 req-c3868944-8460-4331-a981-9351079597cc service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a5e53c42-5347-40ac-a958-ae934e6be897 req-c3868944-8460-4331-a981-9351079597cc service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-a5e53c42-5347-40ac-a958-ae934e6be897 req-c3868944-8460-4331-a981-9351079597cc service nova] [instance: 69202d93-711c-483d-9139-259980900b76] No waiting events found dispatching network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:57 user nova-compute[73503]: WARNING nova.compute.manager [req-a5e53c42-5347-40ac-a958-ae934e6be897 req-c3868944-8460-4331-a981-9351079597cc service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received unexpected event network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 for instance with vm_state building and task_state spawning.
Aug 26 13:28:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056539.0705395, 69202d93-711c-483d-9139-259980900b76 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] VM Resumed (Lifecycle Event)
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 69202d93-711c-483d-9139-259980900b76] Instance spawned successfully.
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056539.0730972, 69202d93-711c-483d-9139-259980900b76 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] VM Started (Lifecycle Event)
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 69202d93-711c-483d-9139-259980900b76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-42822b7b-e558-49ef-899e-58d9722421ca req-b952a15a-7861-4af5-b40d-dfb3e437cdce service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-42822b7b-e558-49ef-899e-58d9722421ca req-b952a15a-7861-4af5-b40d-dfb3e437cdce service nova] Acquiring lock "69202d93-711c-483d-9139-259980900b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-42822b7b-e558-49ef-899e-58d9722421ca req-b952a15a-7861-4af5-b40d-dfb3e437cdce service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-42822b7b-e558-49ef-899e-58d9722421ca req-b952a15a-7861-4af5-b40d-dfb3e437cdce service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:28:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-42822b7b-e558-49ef-899e-58d9722421ca req-b952a15a-7861-4af5-b40d-dfb3e437cdce service nova] [instance: 69202d93-711c-483d-9139-259980900b76] No waiting events found dispatching network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:28:59 user nova-compute[73503]: WARNING nova.compute.manager [req-42822b7b-e558-49ef-899e-58d9722421ca req-b952a15a-7861-4af5-b40d-dfb3e437cdce service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received unexpected event network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 for instance with vm_state building and task_state spawning.
Aug 26 13:28:59 user nova-compute[73503]: INFO nova.compute.manager [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Took 6.25 seconds to build instance.
Aug 26 13:28:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5e2d39c-3b91-4f14-8bcf-f0bcf11d6fcd tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "69202d93-711c-483d-9139-259980900b76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.337s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:03 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquired lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:29:03 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'info_cache' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:03 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.network.neutron [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating instance_info_cache with network_info: [{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Releasing lock "refresh_cache-da1fecf0-ecdf-4e5a-91c5-b83676d953ec" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance destroyed successfully.
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'resources' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG os_vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d4a2ae9-81, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:29:04 user nova-compute[73503]: INFO os_vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81')
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start _get_guest_xml network_info=[{"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'numa_topology' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-changed-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Refreshing instance network info cache due to event network-changed-6c8499ac-a7b3-4817-af36-231c4102f096. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] Acquiring lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] Acquired lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Refreshing network info cache for port 6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:04 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:04 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'vcpu_model' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'pci_devices' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:29:04 user nova-compute[73503]:   <uuid>da1fecf0-ecdf-4e5a-91c5-b83676d953ec</uuid>
Aug 26 13:29:04 user nova-compute[73503]:   <name>instance-00000017</name>
Aug 26 13:29:04 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:29:04 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:29:04 user nova-compute[73503]:   <metadata>
Aug 26 13:29:04 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:29:04 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:29:04 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeTestJSON-server-236484995</nova:name>
Aug 26 13:29:04 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:29:04</nova:creationTime>
Aug 26 13:29:04 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:29:04 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:29:04 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:29:04 user nova-compute[73503]:       <nova:owner>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:user uuid="ad6390e5b4c64754ab6f14217f4da833">tempest-AttachVolumeTestJSON-1183738962-project-member</nova:user>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:project uuid="2c8314eb6dec444ea31e9685d11b2fac">tempest-AttachVolumeTestJSON-1183738962</nova:project>
Aug 26 13:29:04 user nova-compute[73503]:       </nova:owner>
Aug 26 13:29:04 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:29:04 user nova-compute[73503]:       <nova:ports>
Aug 26 13:29:04 user nova-compute[73503]:         <nova:port uuid="8d4a2ae9-81c6-46c2-b949-749cb1976f32">
Aug 26 13:29:04 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:29:04 user nova-compute[73503]:         </nova:port>
Aug 26 13:29:04 user nova-compute[73503]:       </nova:ports>
Aug 26 13:29:04 user nova-compute[73503]:     </nova:instance>
Aug 26 13:29:04 user nova-compute[73503]:   </metadata>
Aug 26 13:29:04 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:29:04 user nova-compute[73503]:     <system>
Aug 26 13:29:04 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:29:04 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:29:04 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:29:04 user nova-compute[73503]:       <entry name="serial">da1fecf0-ecdf-4e5a-91c5-b83676d953ec</entry>
Aug 26 13:29:04 user nova-compute[73503]:       <entry name="uuid">da1fecf0-ecdf-4e5a-91c5-b83676d953ec</entry>
Aug 26 13:29:04 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:29:04 user nova-compute[73503]:     </system>
Aug 26 13:29:04 user nova-compute[73503]:   </sysinfo>
Aug 26 13:29:04 user nova-compute[73503]:   <os>
Aug 26 13:29:04 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:29:04 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:29:04 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:29:04 user nova-compute[73503]:   </os>
Aug 26 13:29:04 user nova-compute[73503]:   <features>
Aug 26 13:29:04 user nova-compute[73503]:     <acpi/>
Aug 26 13:29:04 user nova-compute[73503]:     <apic/>
Aug 26 13:29:04 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:29:04 user nova-compute[73503]:   </features>
Aug 26 13:29:04 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:29:04 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:29:04 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:29:04 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:29:04 user nova-compute[73503]:   </clock>
Aug 26 13:29:04 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:29:04 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:29:04 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:29:04 user nova-compute[73503]:   </cpu>
Aug 26 13:29:04 user nova-compute[73503]:   <devices>
Aug 26 13:29:04 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:29:04 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:29:04 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk"/>
Aug 26 13:29:04 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:29:04 user nova-compute[73503]:     </disk>
Aug 26 13:29:04 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:29:04 user nova-compute[73503]:       <mac address="fa:16:3e:89:cd:85"/>
Aug 26 13:29:04 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:29:04 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:29:04 user nova-compute[73503]:       <target dev="tap8d4a2ae9-81"/>
Aug 26 13:29:04 user nova-compute[73503]:     </interface>
Aug 26 13:29:04 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:29:04 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/console.log" append="off"/>
Aug 26 13:29:04 user nova-compute[73503]:     </serial>
Aug 26 13:29:04 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:29:04 user nova-compute[73503]:     <video>
Aug 26 13:29:04 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:29:04 user nova-compute[73503]:     </video>
Aug 26 13:29:04 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:29:04 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:29:04 user nova-compute[73503]:     </rng>
Aug 26 13:29:04 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:29:04 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:29:04 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:29:04 user nova-compute[73503]:     </memballoon>
Aug 26 13:29:04 user nova-compute[73503]:   </devices>
Aug 26 13:29:04 user nova-compute[73503]: </domain>
Aug 26 13:29:04 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'trusted_certs' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.227s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updated VIF entry in instance network info cache for port 6c8499ac-a7b3-4817-af36-231c4102f096. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updating instance_info_cache with network_info: [{"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6aff778f-5527-4bf0-90d2-fb2d498b1108 req-c89c984c-7f6c-40c0-95b9-de44c396e759 service nova] Releasing lock "refresh_cache-dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Cannot resize image /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.objects.instance [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'migration_context' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.objects.base [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Object Instance<da1fecf0-ecdf-4e5a-91c5-b83676d953ec> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:27:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG os_vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d4a2ae9-81, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d4a2ae9-81, col_values=(('external_ids', {'iface-id': '8d4a2ae9-81c6-46c2-b949-749cb1976f32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:cd:85', 'vm-uuid': 'da1fecf0-ecdf-4e5a-91c5-b83676d953ec'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:29:05 user nova-compute[73503]: INFO os_vif [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81')
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:29:06 user nova-compute[73503]: INFO nova.compute.claims [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Claim successful on node user
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.network.neutron [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:29:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG nova.policy [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a89a1af8a5843ed93bf6f11556e1f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b965a76e3c04068b81deca48c6efba6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:29:06 user nova-compute[73503]: INFO nova.virt.block_device [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Booting with volume-backed-image 7020aec7-4750-4619-aaeb-1eb3136ee3e8 at /dev/vda
Aug 26 13:29:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-1ba29410-9eb8-421a-a33d-8f4365ad3318 req-b1dd5165-fd56-4b8b-9feb-17601b73b9f3 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ba29410-9eb8-421a-a33d-8f4365ad3318 req-b1dd5165-fd56-4b8b-9feb-17601b73b9f3 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ba29410-9eb8-421a-a33d-8f4365ad3318 req-b1dd5165-fd56-4b8b-9feb-17601b73b9f3 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ba29410-9eb8-421a-a33d-8f4365ad3318 req-b1dd5165-fd56-4b8b-9feb-17601b73b9f3 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-1ba29410-9eb8-421a-a33d-8f4365ad3318 req-b1dd5165-fd56-4b8b-9feb-17601b73b9f3 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:07 user nova-compute[73503]: WARNING nova.compute.manager [req-1ba29410-9eb8-421a-a33d-8f4365ad3318 req-b1dd5165-fd56-4b8b-9feb-17601b73b9f3 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state powering-on.
Aug 26 13:29:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG nova.network.neutron [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Successfully created port: 1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:29:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Successfully updated port: 1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:29:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:29:08 user nova-compute[73503]: DEBUG nova.network.neutron [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.network.neutron [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating instance_info_cache with network_info: [{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance network_info: |[{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056549.3270843, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:29:09 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Resumed (Lifecycle Event)
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:09 user nova-compute[73503]: WARNING nova.compute.manager [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state stopped and task_state powering-on.
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-changed-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Refreshing instance network info cache due to event network-changed-1397c3a8-2a80-4ffe-a02c-5a0f1613d066. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] Acquiring lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] Acquired lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Refreshing network info cache for port 1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:29:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance rebooted successfully.
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-430c6bfb-113b-43e7-91c9-8d8aec7eb852 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:29:09 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056549.3300734, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:29:09 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Started (Lifecycle Event)
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updated VIF entry in instance network info cache for port 1397c3a8-2a80-4ffe-a02c-5a0f1613d066. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating instance_info_cache with network_info: [{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8dc9a97e-1e08-4823-ae0a-a8f83be5ca29 req-a508a77e-6bcc-4d24-884d-2921136a33a5 service nova] Releasing lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:29:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG os_brick.utils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a98b3c8-2ec3-45be-902f-44d8406b38a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd517a7d-b443-4649-94ef-68f5faa3d657]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[15925eac-ba23-4f75-a1da-ef94f385cca5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55331a9-54cf-4d55-be7e-4545573480d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:29:17 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:29:17 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb1d37-df93-41d1-8a19-3a2dffee9b7b]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG os_brick.utils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating existing volume attachment record: f5070618-0d01-4562-a83f-fb2a58409759 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:29:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:29:18 user nova-compute[73503]: INFO nova.compute.claims [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Claim successful on node user
Aug 26 13:29:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:29:18 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.network.neutron [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:29:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:29:19 user nova-compute[73503]: INFO nova.virt.block_device [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Booting with volume snapshot 64e629ca-37ee-4e40-84d2-84f6a3a88ca3 at /dev/vda
Aug 26 13:29:19 user nova-compute[73503]: DEBUG nova.policy [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122b92a79d3242f2903b15430240eace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c42bf18354f55954102eed4da2d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:29:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Successfully created port: 9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:29:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Successfully updated port: 9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquired lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-changed-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Refreshing instance network info cache due to event network-changed-9dc79551-9902-4d0f-904e-4deaba43060f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] Acquiring lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updating instance_info_cache with network_info: [{"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Releasing lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Instance network_info: |[{"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] Acquired lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.network.neutron [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Refreshing network info cache for port 9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:29:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updated VIF entry in instance network info cache for port 9dc79551-9902-4d0f-904e-4deaba43060f. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updating instance_info_cache with network_info: [{"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0515894c-158b-4d7a-b50d-25b7155c8fe1 req-a040ce46-db5b-49e2-89b8-4b023d26482b service nova] Releasing lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:29:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG os_brick.utils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9a6cb5-2eb4-4f78-ae14-418409d11497]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adc7982-ee07-477f-be06-bdbffdfb3070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[58608eb1-05be-42e9-b371-76e05ccc7d03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c7e26-0c7c-42d3-b493-a0a4bb768746]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:29:24 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b237d09-9097-4b0e-b9f1-f43d800711b6]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG os_brick.utils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updating existing volume attachment record: 4bc9bc86-30ba-4ae5-8a6e-48000f51cf3e {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:29:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:28 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:28 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7425MB free_disk=24.941162109375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance ac1098c8-c3d6-4f13-9093-3a4100e41299 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 69202d93-711c-483d-9139-259980900b76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 913e0026-81a6-4c4a-9abc-bef635dbbfe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:29:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:29:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Creating image(s)
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Ensure instance console log exists: /opt/stack/data/nova/instances/913e0026-81a6-4c4a-9abc-bef635dbbfe2/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Start _get_guest_xml network_info=[{"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T13:29:06Z,direct_url=<?>,disk_format='qcow2',id=db89e196-50be-4d3d-a2ca-2fb2f29e2632,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1733357565',owner='c56c42bf18354f55954102eed4da2d58',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T13:29:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzViOUKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '913e0026-81a6-4c4a-9abc-bef635dbbfe2', 'attached_at': '', 'detached_at': '', 'volume_id': '6c5f5164-191f-4808-be79-5e8410131ab0', 'serial': '6c5f5164-191f-4808-be79-5e8410131ab0'}, 'attachment_id': '4bc9bc86-30ba-4ae5-8a6e-48000f51cf3e', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:29:36 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:36 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T13:29:06Z,direct_url=<?>,disk_format='qcow2',id=db89e196-50be-4d3d-a2ca-2fb2f29e2632,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1733357565',owner='c56c42bf18354f55954102eed4da2d58',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T13:29:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzViOUKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:29:36 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:29:36 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:29:36 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d72f25-9ea2-4656-8078-ab7e187e51f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:29:36 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf4b4f-14c0-4a5b-bd62-aca7f7ce3592]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0] added
Aug 26 13:29:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fce9693-2853-440d-9eb6-56219871fac5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b075bb-ed46-4386-992b-a08d198adfd5]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzViOUKf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzViOUKf" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfaa854-7ebe-459a-939e-e96947282dc2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SzViOUKf'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c8a63-7756-41d0-bfca-ee7a855c508f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f807a0f6-a4bb-4dbe-af11-983b94c7ff37]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa92ba43-ad26-4ee1-81fd-20e6229b3517]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260]
Aug 26 13:29:36 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260] successful.
Aug 26 13:29:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f40648-efba-412b-9433-9cfe61ec4210]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5f483c-93b6-4b07-b5e7-68b7a88b8ec5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:36 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff4c1ba-8eea-4e91-be41-595fe5a9f36b]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:29:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzViOUKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26666616662326135', 'path': '/dev/sdd'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666616662326135', 'path': '/dev/sdd'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-569134076',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-569134076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-569134076',id=36,image_ref='db89e196-50be-4d3d-a2ca-2fb2f29e2632',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEOf7fQuyg9aZPSsnGjg7QlwWStGY3TS3DJ1fQr6WfzDzE5qkHGZWlBxS3c78+epx4G+THHK/LdQoTheglvYxoa1IDpnKAw6BvEqyskMb+10kZnwKW/svPul+Oqb5Kqbw==',key_name='tempest-keypair-1906734292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-1kggp9id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-813053503',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122b92a79d3242f2903b15430240eace',uuid=913e0026-81a6-4c4a-9abc-bef635dbbfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.objects.instance [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'pci_devices' on Instance uuid 913e0026-81a6-4c4a-9abc-bef635dbbfe2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:29:37 user nova-compute[73503]:   <uuid>913e0026-81a6-4c4a-9abc-bef635dbbfe2</uuid>
Aug 26 13:29:37 user nova-compute[73503]:   <name>instance-00000024</name>
Aug 26 13:29:37 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:29:37 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:29:37 user nova-compute[73503]:   <metadata>
Aug 26 13:29:37 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:29:37 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:29:37 user nova-compute[73503]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-569134076</nova:name>
Aug 26 13:29:37 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:29:36</nova:creationTime>
Aug 26 13:29:37 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:29:37 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:29:37 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:29:37 user nova-compute[73503]:       <nova:owner>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:user uuid="122b92a79d3242f2903b15430240eace">tempest-TestVolumeBootPattern-813053503-project-member</nova:user>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:project uuid="c56c42bf18354f55954102eed4da2d58">tempest-TestVolumeBootPattern-813053503</nova:project>
Aug 26 13:29:37 user nova-compute[73503]:       </nova:owner>
Aug 26 13:29:37 user nova-compute[73503]:       <nova:root type="image" uuid="db89e196-50be-4d3d-a2ca-2fb2f29e2632"/>
Aug 26 13:29:37 user nova-compute[73503]:       <nova:ports>
Aug 26 13:29:37 user nova-compute[73503]:         <nova:port uuid="9dc79551-9902-4d0f-904e-4deaba43060f">
Aug 26 13:29:37 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:29:37 user nova-compute[73503]:         </nova:port>
Aug 26 13:29:37 user nova-compute[73503]:       </nova:ports>
Aug 26 13:29:37 user nova-compute[73503]:     </nova:instance>
Aug 26 13:29:37 user nova-compute[73503]:   </metadata>
Aug 26 13:29:37 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:29:37 user nova-compute[73503]:     <system>
Aug 26 13:29:37 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:29:37 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:29:37 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:29:37 user nova-compute[73503]:       <entry name="serial">913e0026-81a6-4c4a-9abc-bef635dbbfe2</entry>
Aug 26 13:29:37 user nova-compute[73503]:       <entry name="uuid">913e0026-81a6-4c4a-9abc-bef635dbbfe2</entry>
Aug 26 13:29:37 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:29:37 user nova-compute[73503]:     </system>
Aug 26 13:29:37 user nova-compute[73503]:   </sysinfo>
Aug 26 13:29:37 user nova-compute[73503]:   <os>
Aug 26 13:29:37 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:29:37 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:29:37 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:29:37 user nova-compute[73503]:   </os>
Aug 26 13:29:37 user nova-compute[73503]:   <features>
Aug 26 13:29:37 user nova-compute[73503]:     <acpi/>
Aug 26 13:29:37 user nova-compute[73503]:     <apic/>
Aug 26 13:29:37 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:29:37 user nova-compute[73503]:   </features>
Aug 26 13:29:37 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:29:37 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:29:37 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:29:37 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:29:37 user nova-compute[73503]:   </clock>
Aug 26 13:29:37 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:29:37 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:29:37 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:29:37 user nova-compute[73503]:   </cpu>
Aug 26 13:29:37 user nova-compute[73503]:   <devices>
Aug 26 13:29:37 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:29:37 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:29:37 user nova-compute[73503]:       <source dev="/dev/sdd"/>
Aug 26 13:29:37 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:29:37 user nova-compute[73503]:       <serial>6c5f5164-191f-4808-be79-5e8410131ab0</serial>
Aug 26 13:29:37 user nova-compute[73503]:     </disk>
Aug 26 13:29:37 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:29:37 user nova-compute[73503]:       <mac address="fa:16:3e:06:67:af"/>
Aug 26 13:29:37 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:29:37 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:29:37 user nova-compute[73503]:       <target dev="tap9dc79551-99"/>
Aug 26 13:29:37 user nova-compute[73503]:     </interface>
Aug 26 13:29:37 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:29:37 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/913e0026-81a6-4c4a-9abc-bef635dbbfe2/console.log" append="off"/>
Aug 26 13:29:37 user nova-compute[73503]:     </serial>
Aug 26 13:29:37 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:29:37 user nova-compute[73503]:     <video>
Aug 26 13:29:37 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:29:37 user nova-compute[73503]:     </video>
Aug 26 13:29:37 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:29:37 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:29:37 user nova-compute[73503]:     </rng>
Aug 26 13:29:37 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:29:37 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:29:37 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:29:37 user nova-compute[73503]:     </memballoon>
Aug 26 13:29:37 user nova-compute[73503]:   </devices>
Aug 26 13:29:37 user nova-compute[73503]: </domain>
Aug 26 13:29:37 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-569134076',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-569134076',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-569134076',id=36,image_ref='db89e196-50be-4d3d-a2ca-2fb2f29e2632',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEOf7fQuyg9aZPSsnGjg7QlwWStGY3TS3DJ1fQr6WfzDzE5qkHGZWlBxS3c78+epx4G+THHK/LdQoTheglvYxoa1IDpnKAw6BvEqyskMb+10kZnwKW/svPul+Oqb5Kqbw==',key_name='tempest-keypair-1906734292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-1kggp9id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-813053503',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:29:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122b92a79d3242f2903b15430240eace',uuid=913e0026-81a6-4c4a-9abc-bef635dbbfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG os_vif [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dc79551-99, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dc79551-99, col_values=(('external_ids', {'iface-id': '9dc79551-9902-4d0f-904e-4deaba43060f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:67:af', 'vm-uuid': '913e0026-81a6-4c4a-9abc-bef635dbbfe2'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:37 user nova-compute[73503]: INFO os_vif [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99')
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No VIF found with MAC fa:16:3e:06:67:af, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:29:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:29:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Creating image(s)
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Ensure instance console log exists: /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Start _get_guest_xml network_info=[{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f167a1d-4fc5-4938-bb6e-e0fbb90b542a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7ff8be1-4f0c-452e-a991-65eaeca097b3', 'serial': 'b7ff8be1-4f0c-452e-a991-65eaeca097b3'}, 'attachment_id': 'f5070618-0d01-4562-a83f-fb2a58409759', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:29:38 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:38 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:29:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:29:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:29:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:29:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:29:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:29:38 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:29:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ae6854-9b81-4637-b508-01c6ff1db5ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:29:39 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68a4ca-fb4f-4093-b795-d13c336a9b52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3] added
Aug 26 13:29:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa72f2e-e2ba-43a0-8f0a-ffa762a30aa6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-60145471-74bb-4e16-971a-08e8880358f4 req-6a6442d6-1d95-4484-a619-bd8eca7383f5 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-60145471-74bb-4e16-971a-08e8880358f4 req-6a6442d6-1d95-4484-a619-bd8eca7383f5 service nova] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-60145471-74bb-4e16-971a-08e8880358f4 req-6a6442d6-1d95-4484-a619-bd8eca7383f5 service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-60145471-74bb-4e16-971a-08e8880358f4 req-6a6442d6-1d95-4484-a619-bd8eca7383f5 service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-60145471-74bb-4e16-971a-08e8880358f4 req-6a6442d6-1d95-4484-a619-bd8eca7383f5 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] No waiting events found dispatching network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:39 user nova-compute[73503]: WARNING nova.compute.manager [req-60145471-74bb-4e16-971a-08e8880358f4 req-6a6442d6-1d95-4484-a619-bd8eca7383f5 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received unexpected event network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f for instance with vm_state building and task_state spawning.
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbdda85-8060-432e-8341-caf21f3600aa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBYJFfrl {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBYJFfrl" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909e696-e1c1-4457-83e4-72ab6bcf3a1d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jBYJFfrl'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d45f733-cf50-45cc-9230-6bd795f504c6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893eb31-5148-456e-81c0-59a960508fab]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a77c91-9f94-4be1-8dfa-a76a2829e3ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260]
Aug 26 13:29:39 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260] successful.
Aug 26 13:29:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d57fc7-0f1d-4e24-bde7-b162450926a4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aeea30-badc-4ae8-b01f-caaf072586c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:29:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a40ed72-a282-4871-93f0-fc57a6709181]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:29:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23434386134366137', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434386134366137', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978110447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978110447',id=35,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-yvxrix42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:29:07Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=1f167a1d-4fc5-4938-bb6e-e0fbb90b542a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:29:40 user nova-compute[73503]:   <uuid>1f167a1d-4fc5-4938-bb6e-e0fbb90b542a</uuid>
Aug 26 13:29:40 user nova-compute[73503]:   <name>instance-00000023</name>
Aug 26 13:29:40 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:29:40 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:29:40 user nova-compute[73503]:   <metadata>
Aug 26 13:29:40 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:29:40 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:29:40 user nova-compute[73503]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-978110447</nova:name>
Aug 26 13:29:40 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:29:38</nova:creationTime>
Aug 26 13:29:40 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:29:40 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:29:40 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:29:40 user nova-compute[73503]:       <nova:owner>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:user uuid="1a89a1af8a5843ed93bf6f11556e1f65">tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member</nova:user>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:project uuid="9b965a76e3c04068b81deca48c6efba6">tempest-ServerBootFromVolumeStableRescueTest-1652147779</nova:project>
Aug 26 13:29:40 user nova-compute[73503]:       </nova:owner>
Aug 26 13:29:40 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:29:40 user nova-compute[73503]:       <nova:ports>
Aug 26 13:29:40 user nova-compute[73503]:         <nova:port uuid="1397c3a8-2a80-4ffe-a02c-5a0f1613d066">
Aug 26 13:29:40 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:29:40 user nova-compute[73503]:         </nova:port>
Aug 26 13:29:40 user nova-compute[73503]:       </nova:ports>
Aug 26 13:29:40 user nova-compute[73503]:     </nova:instance>
Aug 26 13:29:40 user nova-compute[73503]:   </metadata>
Aug 26 13:29:40 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:29:40 user nova-compute[73503]:     <system>
Aug 26 13:29:40 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:29:40 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:29:40 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:29:40 user nova-compute[73503]:       <entry name="serial">1f167a1d-4fc5-4938-bb6e-e0fbb90b542a</entry>
Aug 26 13:29:40 user nova-compute[73503]:       <entry name="uuid">1f167a1d-4fc5-4938-bb6e-e0fbb90b542a</entry>
Aug 26 13:29:40 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:29:40 user nova-compute[73503]:     </system>
Aug 26 13:29:40 user nova-compute[73503]:   </sysinfo>
Aug 26 13:29:40 user nova-compute[73503]:   <os>
Aug 26 13:29:40 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:29:40 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:29:40 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:29:40 user nova-compute[73503]:   </os>
Aug 26 13:29:40 user nova-compute[73503]:   <features>
Aug 26 13:29:40 user nova-compute[73503]:     <acpi/>
Aug 26 13:29:40 user nova-compute[73503]:     <apic/>
Aug 26 13:29:40 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:29:40 user nova-compute[73503]:   </features>
Aug 26 13:29:40 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:29:40 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:29:40 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:29:40 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:29:40 user nova-compute[73503]:   </clock>
Aug 26 13:29:40 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:29:40 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:29:40 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:29:40 user nova-compute[73503]:   </cpu>
Aug 26 13:29:40 user nova-compute[73503]:   <devices>
Aug 26 13:29:40 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:29:40 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:29:40 user nova-compute[73503]:       <source dev="/dev/sdf"/>
Aug 26 13:29:40 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:29:40 user nova-compute[73503]:       <serial>b7ff8be1-4f0c-452e-a991-65eaeca097b3</serial>
Aug 26 13:29:40 user nova-compute[73503]:     </disk>
Aug 26 13:29:40 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:29:40 user nova-compute[73503]:       <mac address="fa:16:3e:4b:0b:87"/>
Aug 26 13:29:40 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:29:40 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:29:40 user nova-compute[73503]:       <target dev="tap1397c3a8-2a"/>
Aug 26 13:29:40 user nova-compute[73503]:     </interface>
Aug 26 13:29:40 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:29:40 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/console.log" append="off"/>
Aug 26 13:29:40 user nova-compute[73503]:     </serial>
Aug 26 13:29:40 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:29:40 user nova-compute[73503]:     <video>
Aug 26 13:29:40 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:29:40 user nova-compute[73503]:     </video>
Aug 26 13:29:40 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:29:40 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:29:40 user nova-compute[73503]:     </rng>
Aug 26 13:29:40 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:29:40 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:29:40 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:29:40 user nova-compute[73503]:     </memballoon>
Aug 26 13:29:40 user nova-compute[73503]:   </devices>
Aug 26 13:29:40 user nova-compute[73503]: </domain>
Aug 26 13:29:40 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978110447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978110447',id=35,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-yvxrix42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:29:07Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=1f167a1d-4fc5-4938-bb6e-e0fbb90b542a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG os_vif [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1397c3a8-2a, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1397c3a8-2a, col_values=(('external_ids', {'iface-id': '1397c3a8-2a80-4ffe-a02c-5a0f1613d066', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0b:87', 'vm-uuid': '1f167a1d-4fc5-4938-bb6e-e0fbb90b542a'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:40 user nova-compute[73503]: INFO os_vif [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a')
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:29:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No VIF found with MAC fa:16:3e:4b:0b:87, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056581.0844069, 913e0026-81a6-4c4a-9abc-bef635dbbfe2 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] VM Resumed (Lifecycle Event)
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Instance spawned successfully.
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056581.0865746, 913e0026-81a6-4c4a-9abc-bef635dbbfe2 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] VM Started (Lifecycle Event)
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-56a7968a-5bb0-4e85-96a3-e808292805e5 req-af29f10f-670f-4900-bea9-1000afa2ba42 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-56a7968a-5bb0-4e85-96a3-e808292805e5 req-af29f10f-670f-4900-bea9-1000afa2ba42 service nova] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-56a7968a-5bb0-4e85-96a3-e808292805e5 req-af29f10f-670f-4900-bea9-1000afa2ba42 service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-56a7968a-5bb0-4e85-96a3-e808292805e5 req-af29f10f-670f-4900-bea9-1000afa2ba42 service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-56a7968a-5bb0-4e85-96a3-e808292805e5 req-af29f10f-670f-4900-bea9-1000afa2ba42 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] No waiting events found dispatching network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:41 user nova-compute[73503]: WARNING nova.compute.manager [req-56a7968a-5bb0-4e85-96a3-e808292805e5 req-af29f10f-670f-4900-bea9-1000afa2ba42 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received unexpected event network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f for instance with vm_state building and task_state spawning.
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 26 13:29:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:29:41 user nova-compute[73503]: INFO nova.compute.manager [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Took 22.96 seconds to build instance.
Aug 26 13:29:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-947f28e5-dbfc-4c41-94dd-99a7ae9f545c tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.073s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:43 user nova-compute[73503]: WARNING nova.compute.manager [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state building and task_state spawning.
Aug 26 13:29:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:43 user nova-compute[73503]: WARNING nova.compute.manager [req-043b4f30-1873-47b4-a0fa-7e34c2672e47 req-671391cd-fc6b-42e6-a04b-1b9b592be3c7 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state building and task_state spawning.
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056584.1352513, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Resumed (Lifecycle Event)
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance spawned successfully.
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056584.1389399, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Started (Lifecycle Event)
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 26 13:29:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:29:44 user nova-compute[73503]: INFO nova.compute.manager [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Took 38.32 seconds to build instance.
Aug 26 13:29:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-512f62b2-b129-43b3-bfc4-5126791b4fce tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.422s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:46 user nova-compute[73503]: INFO nova.compute.manager [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Terminating instance
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-944a3d75-2c47-459c-a274-007a0c1abbd8 req-5be0bbf9-0cb9-4967-8a44-d3699f28dc2c service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-unplugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-944a3d75-2c47-459c-a274-007a0c1abbd8 req-5be0bbf9-0cb9-4967-8a44-d3699f28dc2c service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-944a3d75-2c47-459c-a274-007a0c1abbd8 req-5be0bbf9-0cb9-4967-8a44-d3699f28dc2c service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-944a3d75-2c47-459c-a274-007a0c1abbd8 req-5be0bbf9-0cb9-4967-8a44-d3699f28dc2c service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-944a3d75-2c47-459c-a274-007a0c1abbd8 req-5be0bbf9-0cb9-4967-8a44-d3699f28dc2c service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-unplugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-944a3d75-2c47-459c-a274-007a0c1abbd8 req-5be0bbf9-0cb9-4967-8a44-d3699f28dc2c service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-unplugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:46 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Instance destroyed successfully.
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'resources' on Instance uuid ac1098c8-c3d6-4f13-9093-3a4100e41299 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:23:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2107938244',display_name='tempest-ServerActionsTestOtherA-server-2107938244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2107938244',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-dfmxnzuv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:26:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=ac1098c8-c3d6-4f13-9093-3a4100e41299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "3d573016-adf7-4853-ae4e-12bc20032ad2", "address": "fa:16:3e:5d:bf:6d", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d573016-ad", "ovs_interfaceid": "3d573016-adf7-4853-ae4e-12bc20032ad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_vif [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d573016-ad, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:29:46 user nova-compute[73503]: INFO os_vif [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:bf:6d,bridge_name='br-int',has_traffic_filtering=True,id=3d573016-adf7-4853-ae4e-12bc20032ad2,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d573016-ad')
Aug 26 13:29:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuhMmAsW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:29:46 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a5a8f-4e92-4d88-a503-860458067a45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ac2f78-c3c6-46d8-8f2c-a098e3c3bfe4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:29:46 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:29:46 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:29:46 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045c30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8334a5c-7fb4-4135-ab07-a30c019d6d6b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd21d6b-c7dd-4768-afcc-3054e0682a75]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:29:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[34145818-4581-4d46-a532-200db2ec53cb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a629c6b-6092-4e88-8ea2-cba046b8cf00]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de4a4e-505a-4b92-96db-c3e67eef3be0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8312ac69-58f7-480b-b526-53df82f36d8c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260]
Aug 26 13:29:47 user nova-compute[73503]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd, portal: 172.16.0.220,3260] successful.
Aug 26 13:29:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60538b82-2d4f-4943-ac10-8b7a8ace56cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e3f7a0-3ddc-493a-a6ca-6e3439676829]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] <== disconnect_volume: return (324ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:29:47 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Deleting instance files /opt/stack/data/nova/instances/ac1098c8-c3d6-4f13-9093-3a4100e41299_del
Aug 26 13:29:47 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Deletion of /opt/stack/data/nova/instances/ac1098c8-c3d6-4f13-9093-3a4100e41299_del complete
Aug 26 13:29:47 user nova-compute[73503]: INFO nova.compute.manager [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 13:29:47 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:29:47 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:29:48 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:29:48 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Took 0.95 seconds to deallocate network for instance.
Aug 26 13:29:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] Acquiring lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] No waiting events found dispatching network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:29:48 user nova-compute[73503]: WARNING nova.compute.manager [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received unexpected event network-vif-plugged-3d573016-adf7-4853-ae4e-12bc20032ad2 for instance with vm_state active and task_state deleting.
Aug 26 13:29:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-ab49bc76-d9cf-48fa-a096-902c93d30726 req-98246868-8da2-43df-a14d-954ddb6c3a4f service nova] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Received event network-vif-deleted-3d573016-adf7-4853-ae4e-12bc20032ad2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:29:49 user nova-compute[73503]: INFO nova.compute.manager [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 13:29:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Deleting volume: 60538b82-2d4f-4943-ac10-8b7a8ace56cd {{(pid=73503) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 13:29:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:29:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:29:49 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:29:49 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:29:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:49 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Deleted allocations for instance ac1098c8-c3d6-4f13-9093-3a4100e41299
Aug 26 13:29:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5139bcae-bbff-4de0-81f1-1b8d88de0da1 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "ac1098c8-c3d6-4f13-9093-3a4100e41299" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.898s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:29:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:29:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:29:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:01 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056586.800182, ac1098c8-c3d6-4f13-9093-3a4100e41299 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:30:01 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] VM Stopped (Lifecycle Event)
Aug 26 13:30:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7d06d453-e003-4f86-9109-a4eba1541f06 None None] [instance: ac1098c8-c3d6-4f13-9093-3a4100e41299] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:30:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-changed-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Refreshing instance network info cache due to event network-changed-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] Acquiring lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] Acquired lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG nova.network.neutron [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Refreshing network info cache for port 1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG nova.network.neutron [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updated VIF entry in instance network info cache for port 1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG nova.network.neutron [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updating instance_info_cache with network_info: [{"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c7a8686d-dd54-4f93-aa67-ae6e6a6e4bf3 req-d5381f75-3ec9-4d81-b999-4ccb64233f65 service nova] Releasing lock "refresh_cache-2fc449d6-4fa3-4de4-aba2-4562b1db674e" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:30:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:21 user nova-compute[73503]: INFO nova.compute.manager [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Terminating instance
Aug 26 13:30:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-d078c677-c3f2-43f6-b047-e3752d42b20c req-7b5cfa20-2068-4e40-99d2-bea8434a6022 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-unplugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d078c677-c3f2-43f6-b047-e3752d42b20c req-7b5cfa20-2068-4e40-99d2-bea8434a6022 service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d078c677-c3f2-43f6-b047-e3752d42b20c req-7b5cfa20-2068-4e40-99d2-bea8434a6022 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d078c677-c3f2-43f6-b047-e3752d42b20c req-7b5cfa20-2068-4e40-99d2-bea8434a6022 service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-d078c677-c3f2-43f6-b047-e3752d42b20c req-7b5cfa20-2068-4e40-99d2-bea8434a6022 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-unplugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-d078c677-c3f2-43f6-b047-e3752d42b20c req-7b5cfa20-2068-4e40-99d2-bea8434a6022 service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-unplugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Instance destroyed successfully.
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lazy-loading 'resources' on Instance uuid 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:24:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-523018557',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-523018557',id=30,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsm5frv1VuuEfrbMMQ549CCXk5wbnIAmA0b4+c+RMyqih7oGJ2x7c2afjSVPKpVDBQ0dvlOa4mu4u7bqWODprP5bQg56UELrAGvuBzB0WlZ0anIC45pthw7Asz8KRdnQ==',key_name='tempest-keypair-1858926900',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b92392a06d1e41d49af47410121fabc0',ramdisk_id='',reservation_id='r-9bgjnz2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-568979141',owner_user_name='tempest-AttachVolumeShelveTestJSON-568979141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:28:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad99f2e83e814a07a9f41d00b6bcecde',uuid=9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converting VIF {"id": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "address": "fa:16:3e:77:6d:4b", "network": {"id": "a50a3b35-1f7c-4897-ab47-2067be0aca45", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1284477491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b92392a06d1e41d49af47410121fabc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038813f4-35", "ovs_interfaceid": "038813f4-35c2-4b75-9de1-f2bc3df33fe0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG os_vif [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038813f4-35, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:22 user nova-compute[73503]: INFO os_vif [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:6d:4b,bridge_name='br-int',has_traffic_filtering=True,id=038813f4-35c2-4b75-9de1-f2bc3df33fe0,network=Network(a50a3b35-1f7c-4897-ab47-2067be0aca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038813f4-35')
Aug 26 13:30:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Deleting instance files /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02_del
Aug 26 13:30:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Deletion of /opt/stack/data/nova/instances/9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02_del complete
Aug 26 13:30:22 user nova-compute[73503]: INFO nova.compute.manager [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 13:30:22 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:30:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:23 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Took 1.18 seconds to deallocate network for instance.
Aug 26 13:30:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-5f4263be-893e-49c4-a30d-fc81ed7cd898 req-cdb1d73e-7775-4bb1-b402-4ff9ef7aadce service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-deleted-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 2fc449d6-4fa3-4de4-aba2-4562b1db674e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-b51b6e8b-8414-4d60-883d-d801835d9672 req-7f254a42-c7eb-49ec-b05b-ddfc25bfecad service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b51b6e8b-8414-4d60-883d-d801835d9672 req-7f254a42-c7eb-49ec-b05b-ddfc25bfecad service nova] Acquiring lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b51b6e8b-8414-4d60-883d-d801835d9672 req-7f254a42-c7eb-49ec-b05b-ddfc25bfecad service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b51b6e8b-8414-4d60-883d-d801835d9672 req-7f254a42-c7eb-49ec-b05b-ddfc25bfecad service nova] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-b51b6e8b-8414-4d60-883d-d801835d9672 req-7f254a42-c7eb-49ec-b05b-ddfc25bfecad service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] No waiting events found dispatching network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:23 user nova-compute[73503]: WARNING nova.compute.manager [req-b51b6e8b-8414-4d60-883d-d801835d9672 req-7f254a42-c7eb-49ec-b05b-ddfc25bfecad service nova] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Received unexpected event network-vif-plugged-038813f4-35c2-4b75-9de1-f2bc3df33fe0 for instance with vm_state deleted and task_state None.
Aug 26 13:30:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:24 user nova-compute[73503]: INFO nova.compute.manager [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Attaching volume 5adfbc36-ddc1-44f1-a476-b18aacb334cb to /dev/vdb
Aug 26 13:30:24 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Deleted allocations for instance 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02
Aug 26 13:30:24 user nova-compute[73503]: DEBUG os_brick.utils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[94572b60-30b5-46a7-85cf-4e8eefffcdaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8033e8e-c179-4a9a-a02c-a5904d2faf11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c7034b-6c00-4c79-b16f-31d384aa46c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8370a2a4-1957-425d-a1c2-5ad5216c2884]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bad328da-22cd-4155-9edc-207f24ffd9f9 tempest-AttachVolumeShelveTestJSON-568979141 tempest-AttachVolumeShelveTestJSON-568979141-project-member] Lock "9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:30:24 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e2efb-6f1b-44c7-96d3-f337079440f0]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG os_brick.utils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updating existing volume attachment record: 27872a81-6c44-4eab-869c-9c974fe01d93 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:30:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:27 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:30:27 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7386MB free_disk=24.963443756103516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 69202d93-711c-483d-9139-259980900b76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 913e0026-81a6-4c4a-9abc-bef635dbbfe2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:30:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:28 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:30:28 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:30:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:30:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:37 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056622.362614, 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:30:37 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] VM Stopped (Lifecycle Event)
Aug 26 13:30:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-3970307d-72df-47f8-b291-265751fa2981 None None] [instance: 9f9d1132-9bb5-4b00-9cd9-785c9b7ddc02] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:30:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjuCDpkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:30:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:30:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:30:38 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f66c2dd-928b-43a5-8800-9cbfaa3bdc96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:30:38 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[43581ac3-4417-45e1-bf48-889665cc20cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb] added
Aug 26 13:30:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a59ed-8410-4e7a-ac6b-c69c6b1401a2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21382165-9c5f-45b0-b991-efb9dcc57687]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjuCDpkt {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjuCDpkt" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2898a79-a077-47ad-bd04-efaecec9f5dd]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjuCDpkt'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[25583d0c-3760-47a2-973a-cacf61d2b842]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0247d31c-536c-4f89-916f-1a6fe5995765]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7181566-1076-47cf-a6c5-1c63640f39a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260]
Aug 26 13:30:38 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260] successful.
Aug 26 13:30:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef86e2-1320-46f4-8790-834b8dda52b6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c70d773-0fe4-4de0-b677-78c1512043c5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb (non-flash)
Aug 26 13:30:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:30:38 user nova-compute[73503]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb (non-flash)
Aug 26 13:30:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba75c994-2274-454c-a6e0-1900b3e2e2d9]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:30:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjuCDpkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:30:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:30:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23539336536343738', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:30:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539336536343738', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:30:39 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 2fc449d6-4fa3-4de4-aba2-4562b1db674e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:30:39 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:30:39 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:30:39 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:30:39 user nova-compute[73503]:   <serial>5adfbc36-ddc1-44f1-a476-b18aacb334cb</serial>
Aug 26 13:30:39 user nova-compute[73503]: </disk>
Aug 26 13:30:39 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:30:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:30:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:30:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:00:bc:e7, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:30:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b015aaa9-12f0-44a0-9e73-69560e3493d1 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.035s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:41 user nova-compute[73503]: INFO nova.compute.manager [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Detaching volume 5adfbc36-ddc1-44f1-a476-b18aacb334cb
Aug 26 13:30:41 user nova-compute[73503]: INFO nova.virt.block_device [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Attempting to driver detach volume 5adfbc36-ddc1-44f1-a476-b18aacb334cb from mountpoint /dev/vdb
Aug 26 13:30:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Attempting to detach device vdb from instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:30:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:30:41 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:30:41 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:30:41 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:30:41 user nova-compute[73503]:   <serial>5adfbc36-ddc1-44f1-a476-b18aacb334cb</serial>
Aug 26 13:30:41 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:30:41 user nova-compute[73503]: </disk>
Aug 26 13:30:41 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:30:41 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully detached device vdb from instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e from the persistent domain config.
Aug 26 13:30:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:30:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:30:41 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:30:41 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:30:41 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:30:41 user nova-compute[73503]:   <serial>5adfbc36-ddc1-44f1-a476-b18aacb334cb</serial>
Aug 26 13:30:41 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:30:41 user nova-compute[73503]: </disk>
Aug 26 13:30:41 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056642.4197247, 2fc449d6-4fa3-4de4-aba2-4562b1db674e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:30:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully detached device vdb from instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e from the live domain config.
Aug 26 13:30:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjuCDpkt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:30:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbebfe6f-995b-4508-a004-d5fe609cea42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c565502-162c-45d1-96c6-e73ef1fe54eb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb (non-flash)
Aug 26 13:30:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:30:42 user nova-compute[73503]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb (non-flash)
Aug 26 13:30:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3145520e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19db331-3791-41bc-aab6-a92b492cfa2f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eccbb9d-5cd2-40d3-a93c-077026f03f55]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c968a3c6-fdd8-4cc0-816b-d186ea78bf55]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ede6e9-a5d9-41dc-b5e7-f6fcfa23f52d]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9658e73-e279-480b-8c90-25b8b80283ca]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2cabeb-c2b4-4b4e-ae22-be40101da1ba]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260]
Aug 26 13:30:42 user nova-compute[73503]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb, portal: 172.16.0.220,3260] successful.
Aug 26 13:30:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5adfbc36-ddc1-44f1-a476-b18aacb334cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9117991-5a4c-4e23-b9d8-25cc72d2d98a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== disconnect_volume: return (297ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:43 user nova-compute[73503]: INFO nova.compute.manager [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Terminating instance
Aug 26 13:30:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-29eee2d2-6cd3-46c2-b724-6b0de8b577b0 req-6e719c79-5ed9-405a-ada9-64a47dd5bd7f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-unplugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29eee2d2-6cd3-46c2-b724-6b0de8b577b0 req-6e719c79-5ed9-405a-ada9-64a47dd5bd7f service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29eee2d2-6cd3-46c2-b724-6b0de8b577b0 req-6e719c79-5ed9-405a-ada9-64a47dd5bd7f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29eee2d2-6cd3-46c2-b724-6b0de8b577b0 req-6e719c79-5ed9-405a-ada9-64a47dd5bd7f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-29eee2d2-6cd3-46c2-b724-6b0de8b577b0 req-6e719c79-5ed9-405a-ada9-64a47dd5bd7f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-unplugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-29eee2d2-6cd3-46c2-b724-6b0de8b577b0 req-6e719c79-5ed9-405a-ada9-64a47dd5bd7f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-unplugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG nova.objects.instance [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 2fc449d6-4fa3-4de4-aba2-4562b1db674e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "69202d93-711c-483d-9139-259980900b76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "69202d93-711c-483d-9139-259980900b76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "69202d93-711c-483d-9139-259980900b76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "69202d93-711c-483d-9139-259980900b76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "69202d93-711c-483d-9139-259980900b76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:43 user nova-compute[73503]: INFO nova.compute.manager [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Terminating instance
Aug 26 13:30:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6f4f1d93-f21b-4225-9a01-79aac1727bfd tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.968s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Instance destroyed successfully.
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lazy-loading 'resources' on Instance uuid 7bf15cad-4bbf-4d7f-b811-7cf79758e1af {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-821694891',display_name='tempest-ServerActionsTestOtherA-server-821694891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-821694891',id=6,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSqdf2DN59hJoJWXP/es7EZdfDP6Ewqfi0oQht1K7jAEVe9dHIQKPBewqvvFbArOOi0qrqze0EZPoWHy+O4iOox/nromUqdS3dZ83eNeC/PgWXwS/sLOznge4oQ3DkE3g==',key_name='tempest-keypair-1078189560',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f8967f8280045e8b45d9298bda30914',ramdisk_id='',reservation_id='r-lu26dbrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-856596274',owner_user_name='tempest-ServerActionsTestOtherA-856596274-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a9851519cfc49c388894f0884261586',uuid=7bf15cad-4bbf-4d7f-b811-7cf79758e1af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converting VIF {"id": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "address": "fa:16:3e:5e:76:0f", "network": {"id": "6f83a0db-d1a4-444d-88a1-778c33203475", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-348791271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f8967f8280045e8b45d9298bda30914", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2435b5-a0", "ovs_interfaceid": "8b2435b5-a0f6-40b5-819e-7fb2630cb39e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG os_vif [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-0cab1c23-2037-42b4-baa7-05c20e3808c3 req-ee0a235e-150f-4333-bf4e-a58a30b529d1 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-vif-unplugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0cab1c23-2037-42b4-baa7-05c20e3808c3 req-ee0a235e-150f-4333-bf4e-a58a30b529d1 service nova] Acquiring lock "69202d93-711c-483d-9139-259980900b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0cab1c23-2037-42b4-baa7-05c20e3808c3 req-ee0a235e-150f-4333-bf4e-a58a30b529d1 service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0cab1c23-2037-42b4-baa7-05c20e3808c3 req-ee0a235e-150f-4333-bf4e-a58a30b529d1 service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-0cab1c23-2037-42b4-baa7-05c20e3808c3 req-ee0a235e-150f-4333-bf4e-a58a30b529d1 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] No waiting events found dispatching network-vif-unplugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-0cab1c23-2037-42b4-baa7-05c20e3808c3 req-ee0a235e-150f-4333-bf4e-a58a30b529d1 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-vif-unplugged-c422cece-c137-4510-af35-8545e93757e2 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b2435b5-a0, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: INFO os_vif [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:76:0f,bridge_name='br-int',has_traffic_filtering=True,id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e,network=Network(6f83a0db-d1a4-444d-88a1-778c33203475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2435b5-a0')
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Deleting instance files /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af_del
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Deletion of /opt/stack/data/nova/instances/7bf15cad-4bbf-4d7f-b811-7cf79758e1af_del complete
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.compute.manager [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 13:30:44 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 69202d93-711c-483d-9139-259980900b76] Instance destroyed successfully.
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lazy-loading 'resources' on Instance uuid 69202d93-711c-483d-9139-259980900b76 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-609030607',display_name='tempest-VolumesActionsTest-instance-609030607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-609030607',id=34,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4528507d2e6a4599b81db97d0f3bc0b0',ramdisk_id='',reservation_id='r-xdb67tcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2093075288',owner_user_name='tempest-VolumesActionsTest-2093075288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:28:59Z,user_data=None,user_id='45fe9e01c207444aa5480a6e4ddd480a',uuid=69202d93-711c-483d-9139-259980900b76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converting VIF {"id": "c422cece-c137-4510-af35-8545e93757e2", "address": "fa:16:3e:a5:35:59", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc422cece-c1", "ovs_interfaceid": "c422cece-c137-4510-af35-8545e93757e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG os_vif [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc422cece-c1, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: INFO os_vif [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:35:59,bridge_name='br-int',has_traffic_filtering=True,id=c422cece-c137-4510-af35-8545e93757e2,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc422cece-c1')
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Deleting instance files /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76_del
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Deletion of /opt/stack/data/nova/instances/69202d93-711c-483d-9139-259980900b76_del complete
Aug 26 13:30:44 user nova-compute[73503]: INFO nova.compute.manager [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 69202d93-711c-483d-9139-259980900b76] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 13:30:44 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 69202d93-711c-483d-9139-259980900b76] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 69202d93-711c-483d-9139-259980900b76] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:45 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Took 0.93 seconds to deallocate network for instance.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-9dc82718-06ec-4fb0-b72a-514b5b740154 req-21e479c4-b8cf-46df-bd05-bd49aa3c3fbd service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-deleted-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:45 user nova-compute[73503]: INFO nova.compute.manager [req-9dc82718-06ec-4fb0-b72a-514b5b740154 req-21e479c4-b8cf-46df-bd05-bd49aa3c3fbd service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Neutron deleted interface 8b2435b5-a0f6-40b5-819e-7fb2630cb39e; detaching it from the instance and deleting it from the info cache
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-9dc82718-06ec-4fb0-b72a-514b5b740154 req-21e479c4-b8cf-46df-bd05-bd49aa3c3fbd service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-9dc82718-06ec-4fb0-b72a-514b5b740154 req-21e479c4-b8cf-46df-bd05-bd49aa3c3fbd service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Detach interface failed, port_id=8b2435b5-a0f6-40b5-819e-7fb2630cb39e, reason: Instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 69202d93-711c-483d-9139-259980900b76] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:45 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 69202d93-711c-483d-9139-259980900b76] Took 0.85 seconds to deallocate network for instance.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state deleted and task_state None.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state deleted and task_state None.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state deleted and task_state None.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-unplugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-unplugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-unplugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state deleted and task_state None.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Acquiring lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] No waiting events found dispatching network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:45 user nova-compute[73503]: WARNING nova.compute.manager [req-1155b0a9-92c4-4111-9860-ea4bcc5ef162 req-0a9a8d34-5c26-4c85-bb15-2d75c4620b9f service nova] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Received unexpected event network-vif-plugged-8b2435b5-a0f6-40b5-819e-7fb2630cb39e for instance with vm_state deleted and task_state None.
Aug 26 13:30:45 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.698s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.541s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:46 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Deleted allocations for instance 7bf15cad-4bbf-4d7f-b811-7cf79758e1af
Aug 26 13:30:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-e63255a7-0c64-486b-a024-c149555db6bb req-d7b54b36-4748-4622-8a48-d5d3f300a592 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e63255a7-0c64-486b-a024-c149555db6bb req-d7b54b36-4748-4622-8a48-d5d3f300a592 service nova] Acquiring lock "69202d93-711c-483d-9139-259980900b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e63255a7-0c64-486b-a024-c149555db6bb req-d7b54b36-4748-4622-8a48-d5d3f300a592 service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e63255a7-0c64-486b-a024-c149555db6bb req-d7b54b36-4748-4622-8a48-d5d3f300a592 service nova] Lock "69202d93-711c-483d-9139-259980900b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG nova.compute.manager [req-e63255a7-0c64-486b-a024-c149555db6bb req-d7b54b36-4748-4622-8a48-d5d3f300a592 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] No waiting events found dispatching network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:46 user nova-compute[73503]: WARNING nova.compute.manager [req-e63255a7-0c64-486b-a024-c149555db6bb req-d7b54b36-4748-4622-8a48-d5d3f300a592 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received unexpected event network-vif-plugged-c422cece-c137-4510-af35-8545e93757e2 for instance with vm_state deleted and task_state None.
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c52716b7-2b9f-4f64-a1f2-76c92d266003 tempest-ServerActionsTestOtherA-856596274 tempest-ServerActionsTestOtherA-856596274-project-member] Lock "7bf15cad-4bbf-4d7f-b811-7cf79758e1af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:46 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Deleted allocations for instance 69202d93-711c-483d-9139-259980900b76
Aug 26 13:30:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-84196cf2-c77d-42ed-91f6-e9f6b049add7 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "69202d93-711c-483d-9139-259980900b76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.976s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-9142a9c4-881b-451f-af17-57f91f3f3eef req-fe5ae901-34a3-4e17-8ed4-c0feb20ab468 service nova] [instance: 69202d93-711c-483d-9139-259980900b76] Received event network-vif-deleted-c422cece-c137-4510-af35-8545e93757e2 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:30:53 user nova-compute[73503]: INFO nova.compute.claims [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Claim successful on node user
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:30:53 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.policy [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeb38c05c97845f2b48b81aa5202945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576be623b4ce46609c0ffee21379fd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:30:53 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Creating image(s)
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "/opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "/opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk 1073741824" returned: 0 in 0.047s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Successfully created port: 7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Cannot resize image /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Ensure instance console log exists: /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:54 user nova-compute[73503]: INFO nova.compute.manager [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Terminating instance
Aug 26 13:30:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:30:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-af16bfb9-dbbc-46b0-8a11-a4914cc0a803 req-a36148ec-5726-41ce-bf23-3ec52f85c305 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af16bfb9-dbbc-46b0-8a11-a4914cc0a803 req-a36148ec-5726-41ce-bf23-3ec52f85c305 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af16bfb9-dbbc-46b0-8a11-a4914cc0a803 req-a36148ec-5726-41ce-bf23-3ec52f85c305 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-af16bfb9-dbbc-46b0-8a11-a4914cc0a803 req-a36148ec-5726-41ce-bf23-3ec52f85c305 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-af16bfb9-dbbc-46b0-8a11-a4914cc0a803 req-a36148ec-5726-41ce-bf23-3ec52f85c305 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-af16bfb9-dbbc-46b0-8a11-a4914cc0a803 req-a36148ec-5726-41ce-bf23-3ec52f85c305 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-unplugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:30:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Instance destroyed successfully.
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'resources' on Instance uuid da1fecf0-ecdf-4e5a-91c5-b83676d953ec {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-236484995',display_name='tempest-AttachVolumeTestJSON-server-236484995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-236484995',id=23,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrPiHkNv8SAUL7NIFTDggn0dalrBYlwr2K+Nyl59m+OBc8H4t8/eTOB29HrSLYDbs7f+QlEwFT5Xn2F2lX/HdfeEP8iOkNjlyCsme+uuv5Yo1M0N/fgYnLFlQmjCpCXTg==',key_name='tempest-keypair-196692922',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-hmxbsmze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:29:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=da1fecf0-ecdf-4e5a-91c5-b83676d953ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "address": "fa:16:3e:89:cd:85", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d4a2ae9-81", "ovs_interfaceid": "8d4a2ae9-81c6-46c2-b949-749cb1976f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG os_vif [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d4a2ae9-81, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:30:55 user nova-compute[73503]: INFO os_vif [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:cd:85,bridge_name='br-int',has_traffic_filtering=True,id=8d4a2ae9-81c6-46c2-b949-749cb1976f32,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d4a2ae9-81')
Aug 26 13:30:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Deleting instance files /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec_del
Aug 26 13:30:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Deletion of /opt/stack/data/nova/instances/da1fecf0-ecdf-4e5a-91c5-b83676d953ec_del complete
Aug 26 13:30:55 user nova-compute[73503]: INFO nova.compute.manager [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 13:30:55 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:30:55 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Successfully updated port: 7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquired lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:30:56 user nova-compute[73503]: INFO nova.compute.manager [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Rescuing
Aug 26 13:30:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updating instance_info_cache with network_info: [{"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Releasing lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Instance network_info: |[{"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Start _get_guest_xml network_info=[{"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:30:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:30:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-319884411',display_name='tempest-VolumesSnapshotTestJSON-instance-319884411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-319884411',id=37,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5ap2wFN9Hic/xzDfE99I9pUHZtc8Y42F6JsTflBvuZPbO2z4KcuFC1FAK51/dmdBF/YI45swABv8cR15xN8+FZf2gPZMP5Wcv++JLF3BAUUCyQ0sex40peSb7rtP4hgg==',key_name='tempest-keypair-975803582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576be623b4ce46609c0ffee21379fd9d',ramdisk_id='',reservation_id='r-398rjafq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1292919532',owner_user_name='tempest-VolumesSnapshotTestJSON-1292919532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb38c05c97845f2b48b81aa5202945b',uuid=5d626cfa-cc85-452f-b0a5-a78866419404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converting VIF {"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:30:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d626cfa-cc85-452f-b0a5-a78866419404 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:30:57 user nova-compute[73503]:   <uuid>5d626cfa-cc85-452f-b0a5-a78866419404</uuid>
Aug 26 13:30:57 user nova-compute[73503]:   <name>instance-00000025</name>
Aug 26 13:30:57 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:30:57 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:30:57 user nova-compute[73503]:   <metadata>
Aug 26 13:30:57 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:30:57 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:30:57 user nova-compute[73503]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-319884411</nova:name>
Aug 26 13:30:57 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:30:56</nova:creationTime>
Aug 26 13:30:57 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:30:57 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:30:57 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:30:57 user nova-compute[73503]:       <nova:owner>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:user uuid="aeb38c05c97845f2b48b81aa5202945b">tempest-VolumesSnapshotTestJSON-1292919532-project-member</nova:user>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:project uuid="576be623b4ce46609c0ffee21379fd9d">tempest-VolumesSnapshotTestJSON-1292919532</nova:project>
Aug 26 13:30:57 user nova-compute[73503]:       </nova:owner>
Aug 26 13:30:57 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:30:57 user nova-compute[73503]:       <nova:ports>
Aug 26 13:30:57 user nova-compute[73503]:         <nova:port uuid="7fbcd820-0de2-4247-bab7-a129479abf98">
Aug 26 13:30:57 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 13:30:57 user nova-compute[73503]:         </nova:port>
Aug 26 13:30:57 user nova-compute[73503]:       </nova:ports>
Aug 26 13:30:57 user nova-compute[73503]:     </nova:instance>
Aug 26 13:30:57 user nova-compute[73503]:   </metadata>
Aug 26 13:30:57 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:30:57 user nova-compute[73503]:     <system>
Aug 26 13:30:57 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:30:57 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:30:57 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:30:57 user nova-compute[73503]:       <entry name="serial">5d626cfa-cc85-452f-b0a5-a78866419404</entry>
Aug 26 13:30:57 user nova-compute[73503]:       <entry name="uuid">5d626cfa-cc85-452f-b0a5-a78866419404</entry>
Aug 26 13:30:57 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:30:57 user nova-compute[73503]:     </system>
Aug 26 13:30:57 user nova-compute[73503]:   </sysinfo>
Aug 26 13:30:57 user nova-compute[73503]:   <os>
Aug 26 13:30:57 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:30:57 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:30:57 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:30:57 user nova-compute[73503]:   </os>
Aug 26 13:30:57 user nova-compute[73503]:   <features>
Aug 26 13:30:57 user nova-compute[73503]:     <acpi/>
Aug 26 13:30:57 user nova-compute[73503]:     <apic/>
Aug 26 13:30:57 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:30:57 user nova-compute[73503]:   </features>
Aug 26 13:30:57 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:30:57 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:30:57 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:30:57 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:30:57 user nova-compute[73503]:   </clock>
Aug 26 13:30:57 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:30:57 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:30:57 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:30:57 user nova-compute[73503]:   </cpu>
Aug 26 13:30:57 user nova-compute[73503]:   <devices>
Aug 26 13:30:57 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:30:57 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:30:57 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk"/>
Aug 26 13:30:57 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:30:57 user nova-compute[73503]:     </disk>
Aug 26 13:30:57 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:30:57 user nova-compute[73503]:       <mac address="fa:16:3e:87:4e:42"/>
Aug 26 13:30:57 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:30:57 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:30:57 user nova-compute[73503]:       <target dev="tap7fbcd820-0d"/>
Aug 26 13:30:57 user nova-compute[73503]:     </interface>
Aug 26 13:30:57 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:30:57 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/console.log" append="off"/>
Aug 26 13:30:57 user nova-compute[73503]:     </serial>
Aug 26 13:30:57 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:30:57 user nova-compute[73503]:     <video>
Aug 26 13:30:57 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:30:57 user nova-compute[73503]:     </video>
Aug 26 13:30:57 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:30:57 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:30:57 user nova-compute[73503]:     </rng>
Aug 26 13:30:57 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:30:57 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:30:57 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:30:57 user nova-compute[73503]:     </memballoon>
Aug 26 13:30:57 user nova-compute[73503]:   </devices>
Aug 26 13:30:57 user nova-compute[73503]: </domain>
Aug 26 13:30:57 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-319884411',display_name='tempest-VolumesSnapshotTestJSON-instance-319884411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-319884411',id=37,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5ap2wFN9Hic/xzDfE99I9pUHZtc8Y42F6JsTflBvuZPbO2z4KcuFC1FAK51/dmdBF/YI45swABv8cR15xN8+FZf2gPZMP5Wcv++JLF3BAUUCyQ0sex40peSb7rtP4hgg==',key_name='tempest-keypair-975803582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576be623b4ce46609c0ffee21379fd9d',ramdisk_id='',reservation_id='r-398rjafq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1292919532',owner_user_name='tempest-VolumesSnapshotTestJSON-1292919532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:30:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb38c05c97845f2b48b81aa5202945b',uuid=5d626cfa-cc85-452f-b0a5-a78866419404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converting VIF {"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG os_vif [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fbcd820-0d, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fbcd820-0d, col_values=(('external_ids', {'iface-id': '7fbcd820-0de2-4247-bab7-a129479abf98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:4e:42', 'vm-uuid': '5d626cfa-cc85-452f-b0a5-a78866419404'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:57 user nova-compute[73503]: INFO os_vif [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d')
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No VIF found with MAC fa:16:3e:87:4e:42, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:57 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Took 1.66 seconds to deallocate network for instance.
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating instance_info_cache with network_info: [{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-changed-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Refreshing instance network info cache due to event network-changed-7fbcd820-0de2-4247-bab7-a129479abf98. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] Acquiring lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] Acquired lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Refreshing network info cache for port 7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:57 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Deleted allocations for instance da1fecf0-ecdf-4e5a-91c5-b83676d953ec
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-5d297f7e-ac38-462c-8370-04acee1ef063 req-0dde5b1d-60ac-498b-8cc0-eb4593150b56 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5d297f7e-ac38-462c-8370-04acee1ef063 req-0dde5b1d-60ac-498b-8cc0-eb4593150b56 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5d297f7e-ac38-462c-8370-04acee1ef063 req-0dde5b1d-60ac-498b-8cc0-eb4593150b56 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5d297f7e-ac38-462c-8370-04acee1ef063 req-0dde5b1d-60ac-498b-8cc0-eb4593150b56 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-5d297f7e-ac38-462c-8370-04acee1ef063 req-0dde5b1d-60ac-498b-8cc0-eb4593150b56 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:57 user nova-compute[73503]: WARNING nova.compute.manager [req-5d297f7e-ac38-462c-8370-04acee1ef063 req-0dde5b1d-60ac-498b-8cc0-eb4593150b56 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state active and task_state rescuing.
Aug 26 13:30:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f59b6f4-3714-4b79-ac8a-fe960734d4cb tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.051s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updated VIF entry in instance network info cache for port 7fbcd820-0de2-4247-bab7-a129479abf98. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updating instance_info_cache with network_info: [{"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] Releasing lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] Acquiring lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] Lock "da1fecf0-ecdf-4e5a-91c5-b83676d953ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] No waiting events found dispatching network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:30:58 user nova-compute[73503]: WARNING nova.compute.manager [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received unexpected event network-vif-plugged-8d4a2ae9-81c6-46c2-b949-749cb1976f32 for instance with vm_state deleted and task_state None.
Aug 26 13:30:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-4029c7b1-3103-495b-9294-83b5250dc5c2 req-5305d1b0-c7db-46a9-8856-df8f4cade4e2 service nova] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Received event network-vif-deleted-8d4a2ae9-81c6-46c2-b949-749cb1976f32 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:30:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance destroyed successfully.
Aug 26 13:30:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Attempting a stable device rescue
Aug 26 13:30:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73503) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:30:59 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Creating image(s)
Aug 26 13:30:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "/opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "654caff845a853aa644ec7da2de2035ec5f58e9c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "654caff845a853aa644ec7da2de2035ec5f58e9c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:30:59 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056644.1175485, 7bf15cad-4bbf-4d7f-b811-7cf79758e1af => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:30:59 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] VM Stopped (Lifecycle Event)
Aug 26 13:30:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-982c8b5d-45dc-430a-92a9-6471c3f65119 None None] [instance: 7bf15cad-4bbf-4d7f-b811-7cf79758e1af] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056644.5590055, 69202d93-711c-483d-9139-259980900b76 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:00 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 69202d93-711c-483d-9139-259980900b76] VM Stopped (Lifecycle Event)
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:00 user nova-compute[73503]: WARNING nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state active and task_state rescuing.
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] No waiting events found dispatching network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:00 user nova-compute[73503]: WARNING nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received unexpected event network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 for instance with vm_state building and task_state spawning.
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] No waiting events found dispatching network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:00 user nova-compute[73503]: WARNING nova.compute.manager [req-a8201ec6-7789-4448-87b3-76545fb8f977 req-e0b6efed-56b9-4cac-96ab-6417f396c910 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received unexpected event network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 for instance with vm_state building and task_state spawning.
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6d1309fc-63db-432c-89da-c989d346549e None None] [instance: 69202d93-711c-483d-9139-259980900b76] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.part --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.virt.images [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] 3e81fa94-818b-4bb8-8bf1-5692a1f21f50 was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:31:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.part /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.part /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.converted" returned: 0 in 0.537s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056661.18029, 5d626cfa-cc85-452f-b0a5-a78866419404 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] VM Resumed (Lifecycle Event)
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "654caff845a853aa644ec7da2de2035ec5f58e9c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.113s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "654caff845a853aa644ec7da2de2035ec5f58e9c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "654caff845a853aa644ec7da2de2035ec5f58e9c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Instance spawned successfully.
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056661.180712, 5d626cfa-cc85-452f-b0a5-a78866419404 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] VM Started (Lifecycle Event)
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Took 7.60 seconds to spawn the instance on the hypervisor.
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c,backing_fmt=raw /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c,backing_fmt=raw /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue" returned: 0 in 0.049s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "654caff845a853aa644ec7da2de2035ec5f58e9c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'migration_context' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<1f167a1d-4fc5-4938-bb6e-e0fbb90b542a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Start _get_guest_xml network_info=[{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "vif_mac": "fa:16:3e:4b:0b:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3e81fa94-818b-4bb8-8bf1-5692a1f21f50', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '1f167a1d-4fc5-4938-bb6e-e0fbb90b542a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7ff8be1-4f0c-452e-a991-65eaeca097b3', 'serial': 'b7ff8be1-4f0c-452e-a991-65eaeca097b3'}, 'attachment_id': 'f5070618-0d01-4562-a83f-fb2a58409759', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'resources' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.compute.manager [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Took 8.29 seconds to build instance.
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<1f167a1d-4fc5-4938-bb6e-e0fbb90b542a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'numa_topology' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8a106864-b75b-4298-b6ae-1d7592a99160 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.383s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<1f167a1d-4fc5-4938-bb6e-e0fbb90b542a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:31:01 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:01 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<1f167a1d-4fc5-4938-bb6e-e0fbb90b542a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:31:01 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:31:01 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:31:01 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c42e4-63bf-4925-af15-73149ba5ffb5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jBYJFfrl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 13:31:01 user nova-compute[73503]: node.name = iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3
Aug 26 13:31:01 user nova-compute[73503]: node.tpgt = -1
Aug 26 13:31:01 user nova-compute[73503]: node.startup = automatic
Aug 26 13:31:01 user nova-compute[73503]: node.leading_login = No
Aug 26 13:31:01 user nova-compute[73503]: iface.iscsi_ifacename = default
Aug 26 13:31:01 user nova-compute[73503]: iface.net_ifacename = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.ipaddress = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.prefix_len = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.hwaddress = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.transport_name = tcp
Aug 26 13:31:01 user nova-compute[73503]: iface.initiatorname = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.vlan_id = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.vlan_priority = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.vlan_state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.iface_num = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.mtu = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.port = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.bootproto = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.subnet_mask = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.gateway = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_alt_client_id = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_dns = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_learn_iqn = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_vendor_id_state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_vendor_id = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.dhcp_slp_da = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.fragmentation = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.gratuitous_arp = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.incoming_forwarding = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.tos_state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.tos = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.ttl = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.delayed_ack = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.tcp_nagle = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.tcp_wsf_state = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.tcp_wsf = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.tcp_timer_scale = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.tcp_timestamp = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.redirect = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.def_task_mgmt_timeout = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.header_digest = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.data_digest = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.immediate_data = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.initial_r2t = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.data_seq_inorder = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.data_pdu_inorder = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.erl = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.max_receive_data_len = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.first_burst_len = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.max_outstanding_r2t = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.max_burst_len = 0
Aug 26 13:31:01 user nova-compute[73503]: iface.chap_auth = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.bidi_chap = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.strict_login_compliance = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.discovery_auth = <empty>
Aug 26 13:31:01 user nova-compute[73503]: iface.discovery_logout = <empty>
Aug 26 13:31:01 user nova-compute[73503]: node.discovery_address = <empty>
Aug 26 13:31:01 user nova-compute[73503]: node.discovery_port = 0
Aug 26 13:31:01 user nova-compute[73503]: node.discovery_type = static
Aug 26 13:31:01 user nova-compute[73503]: node.session.initial_cmdsn = 0
Aug 26 13:31:01 user nova-compute[73503]: node.session.initial_login_retry_max = 8
Aug 26 13:31:01 user nova-compute[73503]: node.session.xmit_thread_priority = -20
Aug 26 13:31:01 user nova-compute[73503]: node.session.cmds_max = 128
Aug 26 13:31:01 user nova-compute[73503]: node.session.queue_depth = 32
Aug 26 13:31:01 user nova-compute[73503]: node.session.nr_sessions = 1
Aug 26 13:31:01 user nova-compute[73503]: node.session.auth.authmethod = CHAP
Aug 26 13:31:01 user nova-compute[73503]: node.session.auth.username = jBYJFfrl
Aug 26 13:31:01 user nova-compute[73503]: node.session.auth.password = ***
Aug 26 13:31:01 user nova-compute[73503]: node.session.auth.username_in = <empty>
Aug 26 13:31:01 user nova-compute[73503]: node.session.auth.password_in = <empty>
Aug 26 13:31:01 user nova-compute[73503]: node.session.auth.chap_algs = MD5
Aug 26 13:31:01 user nova-compute[73503]: node.session.timeo.replacement_timeout = 120
Aug 26 13:31:01 user nova-compute[73503]: node.session.err_timeo.abort_timeout = 15
Aug 26 13:31:01 user nova-compute[73503]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 13:31:01 user nova-compute[73503]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 13:31:01 user nova-compute[73503]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.FastAbort = Yes
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.InitialR2T = No
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.ImmediateData = Yes
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.MaxConnections = 1
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 13:31:01 user nova-compute[73503]: node.session.iscsi.ERL = 0
Aug 26 13:31:01 user nova-compute[73503]: node.session.scan = manual
Aug 26 13:31:01 user nova-compute[73503]: node.session.reopen_max = 0
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].address = 172.16.0.220
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].port = 3260
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].startup = manual
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].tcp.window_size = 524288
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].tcp.type_of_service = 0
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].timeo.logout_timeout = 15
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].timeo.login_timeout = 15
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].timeo.auth_timeout = 45
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].iscsi.DataDigest = None
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].iscsi.IFMarker = No
Aug 26 13:31:01 user nova-compute[73503]: node.conn[0].iscsi.OFMarker = No
Aug 26 13:31:01 user nova-compute[73503]: # END RECORD
Aug 26 13:31:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf631bf-2340-4171-8a30-b93cb4ee2bec]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aaabff-e947-4825-b72f-f0a768329ade]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBYJFfrl {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBYJFfrl" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c0f1d4-c6ea-4e3a-a5e1-368850a8c263]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jBYJFfrl'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[62585902-1e6a-43c8-857e-4c2a11cb7d28]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[107ae422-d2ae-4f4c-9a9e-bf227f04a54c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:31:01 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:31:01 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:31:01 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:31:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:31:01 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:31:01 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:31:01 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:31:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] HCTL ('37', '0', '0', 0) found on session 40 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa8812-2010-4838-9832-15106f731a2b]: (4, ('0 0 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Searching for a device in session 40 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== connect_volume: return (172ms) {'type': 'block', 'scsi_wwn': '23434386134366137', 'path': '/dev/sdf'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434386134366137', 'path': '/dev/sdf'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978110447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978110447',id=35,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:29:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-yvxrix42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:29:44Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=1f167a1d-4fc5-4938-bb6e-e0fbb90b542a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "vif_mac": "fa:16:3e:4b:0b:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "vif_mac": "fa:16:3e:4b:0b:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.objects.base [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Object Instance<1f167a1d-4fc5-4938-bb6e-e0fbb90b542a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:31:01 user nova-compute[73503]:   <uuid>1f167a1d-4fc5-4938-bb6e-e0fbb90b542a</uuid>
Aug 26 13:31:01 user nova-compute[73503]:   <name>instance-00000023</name>
Aug 26 13:31:01 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:31:01 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:31:01 user nova-compute[73503]:   <metadata>
Aug 26 13:31:01 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:31:01 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:31:01 user nova-compute[73503]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-978110447</nova:name>
Aug 26 13:31:01 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:31:01</nova:creationTime>
Aug 26 13:31:01 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:31:01 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:31:01 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:31:01 user nova-compute[73503]:       <nova:owner>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:user uuid="1a89a1af8a5843ed93bf6f11556e1f65">tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member</nova:user>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:project uuid="9b965a76e3c04068b81deca48c6efba6">tempest-ServerBootFromVolumeStableRescueTest-1652147779</nova:project>
Aug 26 13:31:01 user nova-compute[73503]:       </nova:owner>
Aug 26 13:31:01 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:31:01 user nova-compute[73503]:       <nova:ports>
Aug 26 13:31:01 user nova-compute[73503]:         <nova:port uuid="1397c3a8-2a80-4ffe-a02c-5a0f1613d066">
Aug 26 13:31:01 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:31:01 user nova-compute[73503]:         </nova:port>
Aug 26 13:31:01 user nova-compute[73503]:       </nova:ports>
Aug 26 13:31:01 user nova-compute[73503]:     </nova:instance>
Aug 26 13:31:01 user nova-compute[73503]:   </metadata>
Aug 26 13:31:01 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:31:01 user nova-compute[73503]:     <system>
Aug 26 13:31:01 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:31:01 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:31:01 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:31:01 user nova-compute[73503]:       <entry name="serial">1f167a1d-4fc5-4938-bb6e-e0fbb90b542a</entry>
Aug 26 13:31:01 user nova-compute[73503]:       <entry name="uuid">1f167a1d-4fc5-4938-bb6e-e0fbb90b542a</entry>
Aug 26 13:31:01 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:31:01 user nova-compute[73503]:     </system>
Aug 26 13:31:01 user nova-compute[73503]:   </sysinfo>
Aug 26 13:31:01 user nova-compute[73503]:   <os>
Aug 26 13:31:01 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:31:01 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:31:01 user nova-compute[73503]:   </os>
Aug 26 13:31:01 user nova-compute[73503]:   <features>
Aug 26 13:31:01 user nova-compute[73503]:     <acpi/>
Aug 26 13:31:01 user nova-compute[73503]:     <apic/>
Aug 26 13:31:01 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:31:01 user nova-compute[73503]:   </features>
Aug 26 13:31:01 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:31:01 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:31:01 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:31:01 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:31:01 user nova-compute[73503]:   </clock>
Aug 26 13:31:01 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:31:01 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:31:01 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:31:01 user nova-compute[73503]:   </cpu>
Aug 26 13:31:01 user nova-compute[73503]:   <devices>
Aug 26 13:31:01 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:31:01 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:31:01 user nova-compute[73503]:       <source dev="/dev/sdf"/>
Aug 26 13:31:01 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:31:01 user nova-compute[73503]:       <serial>b7ff8be1-4f0c-452e-a991-65eaeca097b3</serial>
Aug 26 13:31:01 user nova-compute[73503]:     </disk>
Aug 26 13:31:01 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:31:01 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:31:01 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue"/>
Aug 26 13:31:01 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:31:01 user nova-compute[73503]:       <boot order="1"/>
Aug 26 13:31:01 user nova-compute[73503]:     </disk>
Aug 26 13:31:01 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:31:01 user nova-compute[73503]:       <mac address="fa:16:3e:4b:0b:87"/>
Aug 26 13:31:01 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:01 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:31:01 user nova-compute[73503]:       <target dev="tap1397c3a8-2a"/>
Aug 26 13:31:01 user nova-compute[73503]:     </interface>
Aug 26 13:31:01 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:31:01 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/console.log" append="off"/>
Aug 26 13:31:01 user nova-compute[73503]:     </serial>
Aug 26 13:31:01 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:31:01 user nova-compute[73503]:     <video>
Aug 26 13:31:01 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:01 user nova-compute[73503]:     </video>
Aug 26 13:31:01 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:31:01 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:31:01 user nova-compute[73503]:     </rng>
Aug 26 13:31:01 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:31:01 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:31:01 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:31:01 user nova-compute[73503]:     </memballoon>
Aug 26 13:31:01 user nova-compute[73503]:   </devices>
Aug 26 13:31:01 user nova-compute[73503]: </domain>
Aug 26 13:31:01 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:31:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance destroyed successfully.
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:31:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] No VIF found with MAC fa:16:3e:4b:0b:87, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:31:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-0ea33b17-3f9c-4796-9734-e492f41394f3 req-d3efdfbc-3555-4bbe-8c66-048d431e1507 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0ea33b17-3f9c-4796-9734-e492f41394f3 req-d3efdfbc-3555-4bbe-8c66-048d431e1507 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0ea33b17-3f9c-4796-9734-e492f41394f3 req-d3efdfbc-3555-4bbe-8c66-048d431e1507 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0ea33b17-3f9c-4796-9734-e492f41394f3 req-d3efdfbc-3555-4bbe-8c66-048d431e1507 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-0ea33b17-3f9c-4796-9734-e492f41394f3 req-d3efdfbc-3555-4bbe-8c66-048d431e1507 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:03 user nova-compute[73503]: WARNING nova.compute.manager [req-0ea33b17-3f9c-4796-9734-e492f41394f3 req-d3efdfbc-3555-4bbe-8c66-048d431e1507 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state active and task_state rescuing.
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2c461eb-ab96-46eb-bd3f-0b26a398253f req-e6d721f3-e8b1-411f-911f-0e2d84e06b63 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2c461eb-ab96-46eb-bd3f-0b26a398253f req-e6d721f3-e8b1-411f-911f-0e2d84e06b63 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2c461eb-ab96-46eb-bd3f-0b26a398253f req-e6d721f3-e8b1-411f-911f-0e2d84e06b63 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2c461eb-ab96-46eb-bd3f-0b26a398253f req-e6d721f3-e8b1-411f-911f-0e2d84e06b63 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2c461eb-ab96-46eb-bd3f-0b26a398253f req-e6d721f3-e8b1-411f-911f-0e2d84e06b63 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:05 user nova-compute[73503]: WARNING nova.compute.manager [req-e2c461eb-ab96-46eb-bd3f-0b26a398253f req-e6d721f3-e8b1-411f-911f-0e2d84e06b63 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state active and task_state rescuing.
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056665.9298391, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:05 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Resumed (Lifecycle Event)
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d7d0da9-ca20-4818-b727-b41ee3b0594a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:05 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:31:05 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056665.9321404, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:05 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Started (Lifecycle Event)
Aug 26 13:31:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:06 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:31:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-changed-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Refreshing instance network info cache due to event network-changed-9dc79551-9902-4d0f-904e-4deaba43060f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] Acquiring lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] Acquired lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Refreshing network info cache for port 9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updated VIF entry in instance network info cache for port 9dc79551-9902-4d0f-904e-4deaba43060f. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updating instance_info_cache with network_info: [{"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e682cddc-a652-4fef-953f-3db906ff1acf req-0e6b274f-0193-4d26-a9ce-4990e501f519 service nova] Releasing lock "refresh_cache-913e0026-81a6-4c4a-9abc-bef635dbbfe2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:10 user nova-compute[73503]: INFO nova.compute.manager [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Terminating instance
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056655.6600475, da1fecf0-ecdf-4e5a-91c5-b83676d953ec => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:10 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] VM Stopped (Lifecycle Event)
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.compute.manager [None req-30310d28-affd-466d-9769-0a5c1903b987 None None] [instance: da1fecf0-ecdf-4e5a-91c5-b83676d953ec] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:10 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Instance destroyed successfully.
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'resources' on Instance uuid 913e0026-81a6-4c4a-9abc-bef635dbbfe2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-569134076',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-569134076',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-569134076',id=36,image_ref='db89e196-50be-4d3d-a2ca-2fb2f29e2632',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEOf7fQuyg9aZPSsnGjg7QlwWStGY3TS3DJ1fQr6WfzDzE5qkHGZWlBxS3c78+epx4G+THHK/LdQoTheglvYxoa1IDpnKAw6BvEqyskMb+10kZnwKW/svPul+Oqb5Kqbw==',key_name='tempest-keypair-1906734292',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-1kggp9id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-813053503',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122b92a79d3242f2903b15430240eace',uuid=913e0026-81a6-4c4a-9abc-bef635dbbfe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "9dc79551-9902-4d0f-904e-4deaba43060f", "address": "fa:16:3e:06:67:af", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc79551-99", "ovs_interfaceid": "9dc79551-9902-4d0f-904e-4deaba43060f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG os_vif [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dc79551-99, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:31:10 user nova-compute[73503]: INFO os_vif [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:67:af,bridge_name='br-int',has_traffic_filtering=True,id=9dc79551-9902-4d0f-904e-4deaba43060f,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc79551-99')
Aug 26 13:31:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzViOUKf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:31:10 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:31:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:31:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0c1c50-3362-4a7c-95b1-1041a3c6aaf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af6a59-1ed8-405a-bbf3-321ca77f022d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:31:11 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:31:11 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:31:11 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:31:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:31:11 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:31:11 user nova-compute[73503]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 (non-flash)
Aug 26 13:31:11 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:31:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045a9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0'): ({'sdd'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Removing single pathed devices sdd {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[928d6c80-5f88-4f5b-ad8a-4ee42848513b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69ee2c-8942-4086-a659-41a5b483a033]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flushing IO for device /dev/sdd {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ad273e-9a7f-4a27-bc28-c91722b65c2d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ab867-631e-42a9-a3a1-8307350b5ace]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c2863-a009-4216-b8b8-bb85925cf75a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73a12c1-060e-46a5-b30b-79ae9133ffaa]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260]
Aug 26 13:31:11 user nova-compute[73503]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0, portal: 172.16.0.220,3260] successful.
Aug 26 13:31:11 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c5f5164-191f-4808-be79-5e8410131ab0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a694a95b-a660-4dd1-af55-ab89e83cfc97]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== disconnect_volume: return (313ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:31:11 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Deleting instance files /opt/stack/data/nova/instances/913e0026-81a6-4c4a-9abc-bef635dbbfe2_del
Aug 26 13:31:11 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Deletion of /opt/stack/data/nova/instances/913e0026-81a6-4c4a-9abc-bef635dbbfe2_del complete
Aug 26 13:31:11 user nova-compute[73503]: INFO nova.compute.manager [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-vif-unplugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] No waiting events found dispatching network-vif-unplugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-vif-unplugged-9dc79551-9902-4d0f-904e-4deaba43060f for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] Acquiring lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] No waiting events found dispatching network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:11 user nova-compute[73503]: WARNING nova.compute.manager [req-25902a74-b5e4-4a76-b130-0ea7bf21d8b3 req-0a4323eb-757a-4c13-af52-2689f2c1307c service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received unexpected event network-vif-plugged-9dc79551-9902-4d0f-904e-4deaba43060f for instance with vm_state active and task_state deleting.
Aug 26 13:31:12 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:12 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Took 1.28 seconds to deallocate network for instance.
Aug 26 13:31:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-ffe5b9aa-bf6f-4f1b-8b38-4068941757fa req-ff7ea349-a33c-4811-993d-86a6a4d87187 service nova] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Received event network-vif-deleted-9dc79551-9902-4d0f-904e-4deaba43060f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:13 user nova-compute[73503]: INFO nova.compute.manager [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Took 0.83 seconds to detach 1 volumes for instance.
Aug 26 13:31:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Deleting volume: 6c5f5164-191f-4808-be79-5e8410131ab0 {{(pid=73503) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 13:31:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:13 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:13 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:13 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Deleted allocations for instance 913e0026-81a6-4c4a-9abc-bef635dbbfe2
Aug 26 13:31:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9cca6997-d371-4b88-83ef-5581787c14e8 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "913e0026-81a6-4c4a-9abc-bef635dbbfe2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.868s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:31:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:31:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:31:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updating instance_info_cache with network_info: [{"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:31:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:31:24 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056670.9328258, 913e0026-81a6-4c4a-9abc-bef635dbbfe2 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:25 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] VM Stopped (Lifecycle Event)
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-50559b6e-efd4-41a4-8dac-6c46aaed2b8d None None] [instance: 913e0026-81a6-4c4a-9abc-bef635dbbfe2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:27 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:27 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=24.913108825683594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5d626cfa-cc85-452f-b0a5-a78866419404 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:32 user nova-compute[73503]: INFO nova.compute.manager [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Terminating instance
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-bb9afb4c-e1c2-48a4-92fd-4e6f55b37bcd req-e6b363c4-6402-484f-9b59-89166690c2bd service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-vif-unplugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bb9afb4c-e1c2-48a4-92fd-4e6f55b37bcd req-e6b363c4-6402-484f-9b59-89166690c2bd service nova] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bb9afb4c-e1c2-48a4-92fd-4e6f55b37bcd req-e6b363c4-6402-484f-9b59-89166690c2bd service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bb9afb4c-e1c2-48a4-92fd-4e6f55b37bcd req-e6b363c4-6402-484f-9b59-89166690c2bd service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-bb9afb4c-e1c2-48a4-92fd-4e6f55b37bcd req-e6b363c4-6402-484f-9b59-89166690c2bd service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] No waiting events found dispatching network-vif-unplugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-bb9afb4c-e1c2-48a4-92fd-4e6f55b37bcd req-e6b363c4-6402-484f-9b59-89166690c2bd service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-vif-unplugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:31:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Instance destroyed successfully.
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'resources' on Instance uuid 2fc449d6-4fa3-4de4-aba2-4562b1db674e {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-233459650',display_name='tempest-AttachVolumeNegativeTest-server-233459650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-233459650',id=33,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8NNE2FfakW8ibWsS4kqPX8wwIJ+/l+gt6zuvh4oo9G9bxdyZKNs4ZOTmvGbaaMUrVto0xYVH5h2tG+S0YwsPzdCT2dWzfMwv3JQBENpGpsiDJQwNvfWWPmQ18lC4Tcag==',key_name='tempest-keypair-1389709946',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-n0c5rzbx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=2fc449d6-4fa3-4de4-aba2-4562b1db674e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "address": "fa:16:3e:00:bc:e7", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ff42c67-34", "ovs_interfaceid": "1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG os_vif [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ff42c67-34, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:31:32 user nova-compute[73503]: INFO os_vif [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:bc:e7,bridge_name='br-int',has_traffic_filtering=True,id=1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ff42c67-34')
Aug 26 13:31:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Deleting instance files /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e_del
Aug 26 13:31:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Deletion of /opt/stack/data/nova/instances/2fc449d6-4fa3-4de4-aba2-4562b1db674e_del complete
Aug 26 13:31:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:33 user nova-compute[73503]: INFO nova.compute.manager [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 13:31:33 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:31:33 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:31:33 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:34 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Took 1.01 seconds to deallocate network for instance.
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:34 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Deleted allocations for instance 2fc449d6-4fa3-4de4-aba2-4562b1db674e
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4b8c9157-b57b-4331-90db-f7ab15a7c757 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.450s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] Acquiring lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] Lock "2fc449d6-4fa3-4de4-aba2-4562b1db674e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] No waiting events found dispatching network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:34 user nova-compute[73503]: WARNING nova.compute.manager [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received unexpected event network-vif-plugged-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d for instance with vm_state deleted and task_state None.
Aug 26 13:31:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-6a2d068b-a502-43e3-9bfd-129975f3ee1f req-3d591d2c-c7ba-4371-a5e2-4b1ce5a67bf4 service nova] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Received event network-vif-deleted-1ff42c67-34da-4fbd-b97b-3acc0b6ddd8d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:31:35 user nova-compute[73503]: INFO nova.compute.claims [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Claim successful on node user
Aug 26 13:31:35 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:35 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:31:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:31:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Creating image(s)
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "/opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "/opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "/opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.policy [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45fe9e01c207444aa5480a6e4ddd480a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4528507d2e6a4599b81db97d0f3bc0b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk 1073741824" returned: 0 in 0.057s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:31:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Cannot resize image /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Ensure instance console log exists: /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Successfully created port: 8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Successfully updated port: 8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "refresh_cache-77eb9676-06b7-4a3e-b6cc-58cec7b907dc" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquired lock "refresh_cache-77eb9676-06b7-4a3e-b6cc-58cec7b907dc" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-changed-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Refreshing instance network info cache due to event network-changed-8650ea6d-dada-4add-a010-43a5e29ae4f8. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] Acquiring lock "refresh_cache-77eb9676-06b7-4a3e-b6cc-58cec7b907dc" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.neutron [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Updating instance_info_cache with network_info: [{"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Releasing lock "refresh_cache-77eb9676-06b7-4a3e-b6cc-58cec7b907dc" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Instance network_info: |[{"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] Acquired lock "refresh_cache-77eb9676-06b7-4a3e-b6cc-58cec7b907dc" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Refreshing network info cache for port 8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Start _get_guest_xml network_info=[{"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:31:39 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:39 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1545092434',display_name='tempest-VolumesActionsTest-instance-1545092434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1545092434',id=38,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4528507d2e6a4599b81db97d0f3bc0b0',ramdisk_id='',reservation_id='r-2sv435da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2093075288',owner_user_name='tempest-VolumesActionsTest-2093075288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:36Z,user_data=None,user_id='45fe9e01c207444aa5480a6e4ddd480a',uuid=77eb9676-06b7-4a3e-b6cc-58cec7b907dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converting VIF {"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.objects.instance [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lazy-loading 'pci_devices' on Instance uuid 77eb9676-06b7-4a3e-b6cc-58cec7b907dc {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:31:39 user nova-compute[73503]:   <uuid>77eb9676-06b7-4a3e-b6cc-58cec7b907dc</uuid>
Aug 26 13:31:39 user nova-compute[73503]:   <name>instance-00000026</name>
Aug 26 13:31:39 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:31:39 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:31:39 user nova-compute[73503]:   <metadata>
Aug 26 13:31:39 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:31:39 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:31:39 user nova-compute[73503]:       <nova:name>tempest-VolumesActionsTest-instance-1545092434</nova:name>
Aug 26 13:31:39 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:31:39</nova:creationTime>
Aug 26 13:31:39 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:31:39 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:31:39 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:31:39 user nova-compute[73503]:       <nova:owner>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:user uuid="45fe9e01c207444aa5480a6e4ddd480a">tempest-VolumesActionsTest-2093075288-project-member</nova:user>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:project uuid="4528507d2e6a4599b81db97d0f3bc0b0">tempest-VolumesActionsTest-2093075288</nova:project>
Aug 26 13:31:39 user nova-compute[73503]:       </nova:owner>
Aug 26 13:31:39 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:31:39 user nova-compute[73503]:       <nova:ports>
Aug 26 13:31:39 user nova-compute[73503]:         <nova:port uuid="8650ea6d-dada-4add-a010-43a5e29ae4f8">
Aug 26 13:31:39 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 13:31:39 user nova-compute[73503]:         </nova:port>
Aug 26 13:31:39 user nova-compute[73503]:       </nova:ports>
Aug 26 13:31:39 user nova-compute[73503]:     </nova:instance>
Aug 26 13:31:39 user nova-compute[73503]:   </metadata>
Aug 26 13:31:39 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:31:39 user nova-compute[73503]:     <system>
Aug 26 13:31:39 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:31:39 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:31:39 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:31:39 user nova-compute[73503]:       <entry name="serial">77eb9676-06b7-4a3e-b6cc-58cec7b907dc</entry>
Aug 26 13:31:39 user nova-compute[73503]:       <entry name="uuid">77eb9676-06b7-4a3e-b6cc-58cec7b907dc</entry>
Aug 26 13:31:39 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:31:39 user nova-compute[73503]:     </system>
Aug 26 13:31:39 user nova-compute[73503]:   </sysinfo>
Aug 26 13:31:39 user nova-compute[73503]:   <os>
Aug 26 13:31:39 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:31:39 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:31:39 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:31:39 user nova-compute[73503]:   </os>
Aug 26 13:31:39 user nova-compute[73503]:   <features>
Aug 26 13:31:39 user nova-compute[73503]:     <acpi/>
Aug 26 13:31:39 user nova-compute[73503]:     <apic/>
Aug 26 13:31:39 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:31:39 user nova-compute[73503]:   </features>
Aug 26 13:31:39 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:31:39 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:31:39 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:31:39 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:31:39 user nova-compute[73503]:   </clock>
Aug 26 13:31:39 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:31:39 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:31:39 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:31:39 user nova-compute[73503]:   </cpu>
Aug 26 13:31:39 user nova-compute[73503]:   <devices>
Aug 26 13:31:39 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:31:39 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:31:39 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk"/>
Aug 26 13:31:39 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:31:39 user nova-compute[73503]:     </disk>
Aug 26 13:31:39 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:31:39 user nova-compute[73503]:       <mac address="fa:16:3e:86:5e:98"/>
Aug 26 13:31:39 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:39 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:31:39 user nova-compute[73503]:       <target dev="tap8650ea6d-da"/>
Aug 26 13:31:39 user nova-compute[73503]:     </interface>
Aug 26 13:31:39 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:31:39 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/console.log" append="off"/>
Aug 26 13:31:39 user nova-compute[73503]:     </serial>
Aug 26 13:31:39 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:31:39 user nova-compute[73503]:     <video>
Aug 26 13:31:39 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:39 user nova-compute[73503]:     </video>
Aug 26 13:31:39 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:31:39 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:31:39 user nova-compute[73503]:     </rng>
Aug 26 13:31:39 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:31:39 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:31:39 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:31:39 user nova-compute[73503]:     </memballoon>
Aug 26 13:31:39 user nova-compute[73503]:   </devices>
Aug 26 13:31:39 user nova-compute[73503]: </domain>
Aug 26 13:31:39 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1545092434',display_name='tempest-VolumesActionsTest-instance-1545092434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1545092434',id=38,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4528507d2e6a4599b81db97d0f3bc0b0',ramdisk_id='',reservation_id='r-2sv435da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2093075288',owner_user_name='tempest-VolumesActionsTest-2093075288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:36Z,user_data=None,user_id='45fe9e01c207444aa5480a6e4ddd480a',uuid=77eb9676-06b7-4a3e-b6cc-58cec7b907dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converting VIF {"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG os_vif [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8650ea6d-da, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8650ea6d-da, col_values=(('external_ids', {'iface-id': '8650ea6d-dada-4add-a010-43a5e29ae4f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:5e:98', 'vm-uuid': '77eb9676-06b7-4a3e-b6cc-58cec7b907dc'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:39 user nova-compute[73503]: INFO os_vif [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da')
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] No VIF found with MAC fa:16:3e:86:5e:98, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Updated VIF entry in instance network info cache for port 8650ea6d-dada-4add-a010-43a5e29ae4f8. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Updating instance_info_cache with network_info: [{"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-95d3de86-11f3-44de-912c-c68761199e28 req-7304646d-d5b6-4189-b54f-f25162f779ca service nova] Releasing lock "refresh_cache-77eb9676-06b7-4a3e-b6cc-58cec7b907dc" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-ab49aa2d-116b-4862-950f-6234a33ea57b req-6e69a991-3166-4de2-9c2c-f47f71c62f24 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ab49aa2d-116b-4862-950f-6234a33ea57b req-6e69a991-3166-4de2-9c2c-f47f71c62f24 service nova] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ab49aa2d-116b-4862-950f-6234a33ea57b req-6e69a991-3166-4de2-9c2c-f47f71c62f24 service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ab49aa2d-116b-4862-950f-6234a33ea57b req-6e69a991-3166-4de2-9c2c-f47f71c62f24 service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-ab49aa2d-116b-4862-950f-6234a33ea57b req-6e69a991-3166-4de2-9c2c-f47f71c62f24 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] No waiting events found dispatching network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:41 user nova-compute[73503]: WARNING nova.compute.manager [req-ab49aa2d-116b-4862-950f-6234a33ea57b req-6e69a991-3166-4de2-9c2c-f47f71c62f24 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received unexpected event network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 for instance with vm_state building and task_state spawning.
Aug 26 13:31:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:42 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056702.9592702, 77eb9676-06b7-4a3e-b6cc-58cec7b907dc => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] VM Resumed (Lifecycle Event)
Aug 26 13:31:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:31:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:31:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Instance spawned successfully.
Aug 26 13:31:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:31:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:43 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056702.9616585, 77eb9676-06b7-4a3e-b6cc-58cec7b907dc => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:43 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] VM Started (Lifecycle Event)
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:43 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:31:43 user nova-compute[73503]: INFO nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:43 user nova-compute[73503]: INFO nova.compute.manager [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Took 7.49 seconds to build instance.
Aug 26 13:31:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f9ebed15-a71b-48f7-b95d-69cb20389b70 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-cdc70119-c4b5-41f3-b97d-1f33579dfc20 req-938c7237-a7b6-4a34-bb8c-01fad22f355e service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cdc70119-c4b5-41f3-b97d-1f33579dfc20 req-938c7237-a7b6-4a34-bb8c-01fad22f355e service nova] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cdc70119-c4b5-41f3-b97d-1f33579dfc20 req-938c7237-a7b6-4a34-bb8c-01fad22f355e service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-cdc70119-c4b5-41f3-b97d-1f33579dfc20 req-938c7237-a7b6-4a34-bb8c-01fad22f355e service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-cdc70119-c4b5-41f3-b97d-1f33579dfc20 req-938c7237-a7b6-4a34-bb8c-01fad22f355e service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] No waiting events found dispatching network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:43 user nova-compute[73503]: WARNING nova.compute.manager [req-cdc70119-c4b5-41f3-b97d-1f33579dfc20 req-938c7237-a7b6-4a34-bb8c-01fad22f355e service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received unexpected event network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 for instance with vm_state active and task_state None.
Aug 26 13:31:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:47 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056692.9198697, 2fc449d6-4fa3-4de4-aba2-4562b1db674e => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:47 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] VM Stopped (Lifecycle Event)
Aug 26 13:31:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e80baead-ba5b-4dfa-81e3-bba6fa1ba8a3 None None] [instance: 2fc449d6-4fa3-4de4-aba2-4562b1db674e] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:31:49 user nova-compute[73503]: INFO nova.compute.claims [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Claim successful on node user
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:31:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.policy [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6390e5b4c64754ab6f14217f4da833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8314eb6dec444ea31e9685d11b2fac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:31:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Creating image(s)
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "/opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "/opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.245s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk 1073741824" returned: 0 in 0.049s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.214s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Successfully created port: 329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:31:51 user nova-compute[73503]: INFO nova.compute.claims [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Claim successful on node user
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Cannot resize image /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Ensure instance console log exists: /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:31:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:31:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Creating image(s)
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:51 user nova-compute[73503]: DEBUG nova.policy [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1c5d31dff424c929cd66ba7f031d889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c67b91da188457c8798f0a88c03590c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk 1073741824" returned: 0 in 0.077s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Successfully updated port: 329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquired lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-changed-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Refreshing instance network info cache due to event network-changed-329285b3-6416-41f9-92d6-aef1de3c371c. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] Acquiring lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Checking if we can resize image /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Cannot resize image /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Ensure instance console log exists: /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:31:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updating instance_info_cache with network_info: [{"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:31:53 user nova-compute[73503]: INFO nova.compute.claims [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Claim successful on node user
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Releasing lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Instance network_info: |[{"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] Acquired lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.neutron [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Refreshing network info cache for port 329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Start _get_guest_xml network_info=[{"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:31:53 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:53 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1888828770',display_name='tempest-AttachVolumeTestJSON-server-1888828770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1888828770',id=39,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPCA84IEXGGV0fDL2IbX7qYH3C92ExEMAkz6sQaV/ROYI9kE7B5bDJtR3f2kyPvoI/3B5Q81nXxtSdioSK6WwZ8B50jU2MVeL6Jo7gQ84zRnTlhlk98+/kLktheh7v75A==',key_name='tempest-keypair-1823131430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-nyf0ayx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=81ee370f-84d3-476b-a6c3-5bd7bc334548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:31:53 user nova-compute[73503]:   <uuid>81ee370f-84d3-476b-a6c3-5bd7bc334548</uuid>
Aug 26 13:31:53 user nova-compute[73503]:   <name>instance-00000027</name>
Aug 26 13:31:53 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:31:53 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:31:53 user nova-compute[73503]:   <metadata>
Aug 26 13:31:53 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:31:53 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:31:53 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeTestJSON-server-1888828770</nova:name>
Aug 26 13:31:53 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:31:53</nova:creationTime>
Aug 26 13:31:53 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:31:53 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:31:53 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:31:53 user nova-compute[73503]:       <nova:owner>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:user uuid="ad6390e5b4c64754ab6f14217f4da833">tempest-AttachVolumeTestJSON-1183738962-project-member</nova:user>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:project uuid="2c8314eb6dec444ea31e9685d11b2fac">tempest-AttachVolumeTestJSON-1183738962</nova:project>
Aug 26 13:31:53 user nova-compute[73503]:       </nova:owner>
Aug 26 13:31:53 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:31:53 user nova-compute[73503]:       <nova:ports>
Aug 26 13:31:53 user nova-compute[73503]:         <nova:port uuid="329285b3-6416-41f9-92d6-aef1de3c371c">
Aug 26 13:31:53 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 13:31:53 user nova-compute[73503]:         </nova:port>
Aug 26 13:31:53 user nova-compute[73503]:       </nova:ports>
Aug 26 13:31:53 user nova-compute[73503]:     </nova:instance>
Aug 26 13:31:53 user nova-compute[73503]:   </metadata>
Aug 26 13:31:53 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:31:53 user nova-compute[73503]:     <system>
Aug 26 13:31:53 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:31:53 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:31:53 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:31:53 user nova-compute[73503]:       <entry name="serial">81ee370f-84d3-476b-a6c3-5bd7bc334548</entry>
Aug 26 13:31:53 user nova-compute[73503]:       <entry name="uuid">81ee370f-84d3-476b-a6c3-5bd7bc334548</entry>
Aug 26 13:31:53 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:31:53 user nova-compute[73503]:     </system>
Aug 26 13:31:53 user nova-compute[73503]:   </sysinfo>
Aug 26 13:31:53 user nova-compute[73503]:   <os>
Aug 26 13:31:53 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:31:53 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:31:53 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:31:53 user nova-compute[73503]:   </os>
Aug 26 13:31:53 user nova-compute[73503]:   <features>
Aug 26 13:31:53 user nova-compute[73503]:     <acpi/>
Aug 26 13:31:53 user nova-compute[73503]:     <apic/>
Aug 26 13:31:53 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:31:53 user nova-compute[73503]:   </features>
Aug 26 13:31:53 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:31:53 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:31:53 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:31:53 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:31:53 user nova-compute[73503]:   </clock>
Aug 26 13:31:53 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:31:53 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:31:53 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:31:53 user nova-compute[73503]:   </cpu>
Aug 26 13:31:53 user nova-compute[73503]:   <devices>
Aug 26 13:31:53 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:31:53 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:31:53 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk"/>
Aug 26 13:31:53 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:31:53 user nova-compute[73503]:     </disk>
Aug 26 13:31:53 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:31:53 user nova-compute[73503]:       <mac address="fa:16:3e:60:5d:6d"/>
Aug 26 13:31:53 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:53 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:31:53 user nova-compute[73503]:       <target dev="tap329285b3-64"/>
Aug 26 13:31:53 user nova-compute[73503]:     </interface>
Aug 26 13:31:53 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:31:53 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/console.log" append="off"/>
Aug 26 13:31:53 user nova-compute[73503]:     </serial>
Aug 26 13:31:53 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:31:53 user nova-compute[73503]:     <video>
Aug 26 13:31:53 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:53 user nova-compute[73503]:     </video>
Aug 26 13:31:53 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:31:53 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:31:53 user nova-compute[73503]:     </rng>
Aug 26 13:31:53 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:31:53 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:31:53 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:31:53 user nova-compute[73503]:     </memballoon>
Aug 26 13:31:53 user nova-compute[73503]:   </devices>
Aug 26 13:31:53 user nova-compute[73503]: </domain>
Aug 26 13:31:53 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1888828770',display_name='tempest-AttachVolumeTestJSON-server-1888828770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1888828770',id=39,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPCA84IEXGGV0fDL2IbX7qYH3C92ExEMAkz6sQaV/ROYI9kE7B5bDJtR3f2kyPvoI/3B5Q81nXxtSdioSK6WwZ8B50jU2MVeL6Jo7gQ84zRnTlhlk98+/kLktheh7v75A==',key_name='tempest-keypair-1823131430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-nyf0ayx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=81ee370f-84d3-476b-a6c3-5bd7bc334548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG os_vif [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap329285b3-64, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap329285b3-64, col_values=(('external_ids', {'iface-id': '329285b3-6416-41f9-92d6-aef1de3c371c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:5d:6d', 'vm-uuid': '81ee370f-84d3-476b-a6c3-5bd7bc334548'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:53 user nova-compute[73503]: INFO os_vif [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64')
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No VIF found with MAC fa:16:3e:60:5d:6d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Successfully created port: 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:31:53 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:31:53 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Creating image(s)
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "/opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "/opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "/opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updated VIF entry in instance network info cache for port 329285b3-6416-41f9-92d6-aef1de3c371c. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updating instance_info_cache with network_info: [{"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-30d7c2e4-41d4-4e09-9ff1-07b2bd177500 req-7138124d-1340-4dfa-8d10-563c90a95ff0 service nova] Releasing lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.policy [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a769a9e32954483eb1ad16a225d3676a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac996d683ab4df38b492abdd8f9311f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk 1073741824" returned: 0 in 0.060s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.260s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Cannot resize image /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Ensure instance console log exists: /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-87caa7bb-d667-4ce8-a67d-3b523dbda165 req-ad1cf051-43b1-45fb-bf5b-c70f0cb0315c service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-87caa7bb-d667-4ce8-a67d-3b523dbda165 req-ad1cf051-43b1-45fb-bf5b-c70f0cb0315c service nova] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-87caa7bb-d667-4ce8-a67d-3b523dbda165 req-ad1cf051-43b1-45fb-bf5b-c70f0cb0315c service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-87caa7bb-d667-4ce8-a67d-3b523dbda165 req-ad1cf051-43b1-45fb-bf5b-c70f0cb0315c service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-87caa7bb-d667-4ce8-a67d-3b523dbda165 req-ad1cf051-43b1-45fb-bf5b-c70f0cb0315c service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] No waiting events found dispatching network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:55 user nova-compute[73503]: WARNING nova.compute.manager [req-87caa7bb-d667-4ce8-a67d-3b523dbda165 req-ad1cf051-43b1-45fb-bf5b-c70f0cb0315c service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received unexpected event network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c for instance with vm_state building and task_state spawning.
Aug 26 13:31:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Successfully updated port: 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Successfully created port: b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:31:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance network_info: |[{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Start _get_guest_xml network_info=[{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:31:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1286434629',display_name='tempest-ServerStableDeviceRescueTest-server-1286434629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1286434629',id=40,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO803v1ZnwGe07xuV97cGCa9PZQCHx8RnV8gWXHlFNzM6uT8JHsm0zj+rIlavQw4S5XCYFW4ZCIJ+8VEc/rW4EuidFxQS5ce2QH+tYKM68vrGW/bRUa5SRm5/UsjCHiwQg==',key_name='tempest-keypair-442917711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c67b91da188457c8798f0a88c03590c',ramdisk_id='',reservation_id='r-yffjwf3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-903706850',owner_user_name='tempest-ServerStableDeviceRescueTest-903706850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1c5d31dff424c929cd66ba7f031d889',uuid=794e9828-4b77-4d11-84b8-5505e579949d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converting VIF {"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'pci_devices' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:31:56 user nova-compute[73503]:   <uuid>794e9828-4b77-4d11-84b8-5505e579949d</uuid>
Aug 26 13:31:56 user nova-compute[73503]:   <name>instance-00000028</name>
Aug 26 13:31:56 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:31:56 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:31:56 user nova-compute[73503]:   <metadata>
Aug 26 13:31:56 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:31:56 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:31:56 user nova-compute[73503]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1286434629</nova:name>
Aug 26 13:31:56 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:31:56</nova:creationTime>
Aug 26 13:31:56 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:31:56 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:31:56 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:31:56 user nova-compute[73503]:       <nova:owner>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:user uuid="e1c5d31dff424c929cd66ba7f031d889">tempest-ServerStableDeviceRescueTest-903706850-project-member</nova:user>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:project uuid="3c67b91da188457c8798f0a88c03590c">tempest-ServerStableDeviceRescueTest-903706850</nova:project>
Aug 26 13:31:56 user nova-compute[73503]:       </nova:owner>
Aug 26 13:31:56 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:31:56 user nova-compute[73503]:       <nova:ports>
Aug 26 13:31:56 user nova-compute[73503]:         <nova:port uuid="9cfd54a1-f3e1-4d51-bb9b-49aeeb786104">
Aug 26 13:31:56 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 13:31:56 user nova-compute[73503]:         </nova:port>
Aug 26 13:31:56 user nova-compute[73503]:       </nova:ports>
Aug 26 13:31:56 user nova-compute[73503]:     </nova:instance>
Aug 26 13:31:56 user nova-compute[73503]:   </metadata>
Aug 26 13:31:56 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:31:56 user nova-compute[73503]:     <system>
Aug 26 13:31:56 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:31:56 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:31:56 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:31:56 user nova-compute[73503]:       <entry name="serial">794e9828-4b77-4d11-84b8-5505e579949d</entry>
Aug 26 13:31:56 user nova-compute[73503]:       <entry name="uuid">794e9828-4b77-4d11-84b8-5505e579949d</entry>
Aug 26 13:31:56 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:31:56 user nova-compute[73503]:     </system>
Aug 26 13:31:56 user nova-compute[73503]:   </sysinfo>
Aug 26 13:31:56 user nova-compute[73503]:   <os>
Aug 26 13:31:56 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:31:56 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:31:56 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:31:56 user nova-compute[73503]:   </os>
Aug 26 13:31:56 user nova-compute[73503]:   <features>
Aug 26 13:31:56 user nova-compute[73503]:     <acpi/>
Aug 26 13:31:56 user nova-compute[73503]:     <apic/>
Aug 26 13:31:56 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:31:56 user nova-compute[73503]:   </features>
Aug 26 13:31:56 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:31:56 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:31:56 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:31:56 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:31:56 user nova-compute[73503]:   </clock>
Aug 26 13:31:56 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:31:56 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:31:56 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:31:56 user nova-compute[73503]:   </cpu>
Aug 26 13:31:56 user nova-compute[73503]:   <devices>
Aug 26 13:31:56 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:31:56 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:31:56 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk"/>
Aug 26 13:31:56 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:31:56 user nova-compute[73503]:     </disk>
Aug 26 13:31:56 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:31:56 user nova-compute[73503]:       <mac address="fa:16:3e:04:ff:20"/>
Aug 26 13:31:56 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:56 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:31:56 user nova-compute[73503]:       <target dev="tap9cfd54a1-f3"/>
Aug 26 13:31:56 user nova-compute[73503]:     </interface>
Aug 26 13:31:56 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:31:56 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/console.log" append="off"/>
Aug 26 13:31:56 user nova-compute[73503]:     </serial>
Aug 26 13:31:56 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:31:56 user nova-compute[73503]:     <video>
Aug 26 13:31:56 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:56 user nova-compute[73503]:     </video>
Aug 26 13:31:56 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:31:56 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:31:56 user nova-compute[73503]:     </rng>
Aug 26 13:31:56 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:31:56 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:31:56 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:31:56 user nova-compute[73503]:     </memballoon>
Aug 26 13:31:56 user nova-compute[73503]:   </devices>
Aug 26 13:31:56 user nova-compute[73503]: </domain>
Aug 26 13:31:56 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1286434629',display_name='tempest-ServerStableDeviceRescueTest-server-1286434629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1286434629',id=40,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO803v1ZnwGe07xuV97cGCa9PZQCHx8RnV8gWXHlFNzM6uT8JHsm0zj+rIlavQw4S5XCYFW4ZCIJ+8VEc/rW4EuidFxQS5ce2QH+tYKM68vrGW/bRUa5SRm5/UsjCHiwQg==',key_name='tempest-keypair-442917711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c67b91da188457c8798f0a88c03590c',ramdisk_id='',reservation_id='r-yffjwf3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-903706850',owner_user_name='tempest-ServerStableDeviceRescueTest-903706850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1c5d31dff424c929cd66ba7f031d889',uuid=794e9828-4b77-4d11-84b8-5505e579949d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converting VIF {"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG os_vif [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cfd54a1-f3, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cfd54a1-f3, col_values=(('external_ids', {'iface-id': '9cfd54a1-f3e1-4d51-bb9b-49aeeb786104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:ff:20', 'vm-uuid': '794e9828-4b77-4d11-84b8-5505e579949d'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:56 user nova-compute[73503]: INFO os_vif [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3')
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No VIF found with MAC fa:16:3e:04:ff:20, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:31:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Successfully updated port: b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "refresh_cache-edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquired lock "refresh_cache-edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056717.1597414, 81ee370f-84d3-476b-a6c3-5bd7bc334548 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] VM Resumed (Lifecycle Event)
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Instance spawned successfully.
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056717.162928, 81ee370f-84d3-476b-a6c3-5bd7bc334548 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] VM Started (Lifecycle Event)
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Took 6.89 seconds to spawn the instance on the hypervisor.
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:31:57 user nova-compute[73503]: INFO nova.compute.manager [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Took 7.60 seconds to build instance.
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing instance network info cache due to event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d4522842-844e-4548-8445-2abda21859b3 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.713s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Updating instance_info_cache with network_info: [{"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Releasing lock "refresh_cache-edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Instance network_info: |[{"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Start _get_guest_xml network_info=[{"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:31:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1377592966',display_name='tempest-VolumesNegativeTest-instance-1377592966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1377592966',id=41,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac996d683ab4df38b492abdd8f9311f',ramdisk_id='',reservation_id='r-yjwatkcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1756260103',owner_user_name='tempest-VolumesNegativeTest-1756260103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:54Z,user_data=None,user_id='a769a9e32954483eb1ad16a225d3676a',uuid=edabb5ef-a0a9-44b5-b49e-7c4c24fb259b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Converting VIF {"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lazy-loading 'pci_devices' on Instance uuid edabb5ef-a0a9-44b5-b49e-7c4c24fb259b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:31:57 user nova-compute[73503]:   <uuid>edabb5ef-a0a9-44b5-b49e-7c4c24fb259b</uuid>
Aug 26 13:31:57 user nova-compute[73503]:   <name>instance-00000029</name>
Aug 26 13:31:57 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:31:57 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:31:57 user nova-compute[73503]:   <metadata>
Aug 26 13:31:57 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:31:57 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:31:57 user nova-compute[73503]:       <nova:name>tempest-VolumesNegativeTest-instance-1377592966</nova:name>
Aug 26 13:31:57 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:31:57</nova:creationTime>
Aug 26 13:31:57 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:31:57 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:31:57 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:31:57 user nova-compute[73503]:       <nova:owner>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:user uuid="a769a9e32954483eb1ad16a225d3676a">tempest-VolumesNegativeTest-1756260103-project-member</nova:user>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:project uuid="5ac996d683ab4df38b492abdd8f9311f">tempest-VolumesNegativeTest-1756260103</nova:project>
Aug 26 13:31:57 user nova-compute[73503]:       </nova:owner>
Aug 26 13:31:57 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:31:57 user nova-compute[73503]:       <nova:ports>
Aug 26 13:31:57 user nova-compute[73503]:         <nova:port uuid="b3368fdc-ee03-4b93-9a40-ea68bf5703ff">
Aug 26 13:31:57 user nova-compute[73503]:           <nova:ip type="fixed" address="192.168.233.179" ipVersion="4"/>
Aug 26 13:31:57 user nova-compute[73503]:         </nova:port>
Aug 26 13:31:57 user nova-compute[73503]:       </nova:ports>
Aug 26 13:31:57 user nova-compute[73503]:     </nova:instance>
Aug 26 13:31:57 user nova-compute[73503]:   </metadata>
Aug 26 13:31:57 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:31:57 user nova-compute[73503]:     <system>
Aug 26 13:31:57 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:31:57 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:31:57 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:31:57 user nova-compute[73503]:       <entry name="serial">edabb5ef-a0a9-44b5-b49e-7c4c24fb259b</entry>
Aug 26 13:31:57 user nova-compute[73503]:       <entry name="uuid">edabb5ef-a0a9-44b5-b49e-7c4c24fb259b</entry>
Aug 26 13:31:57 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:31:57 user nova-compute[73503]:     </system>
Aug 26 13:31:57 user nova-compute[73503]:   </sysinfo>
Aug 26 13:31:57 user nova-compute[73503]:   <os>
Aug 26 13:31:57 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:31:57 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:31:57 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:31:57 user nova-compute[73503]:   </os>
Aug 26 13:31:57 user nova-compute[73503]:   <features>
Aug 26 13:31:57 user nova-compute[73503]:     <acpi/>
Aug 26 13:31:57 user nova-compute[73503]:     <apic/>
Aug 26 13:31:57 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:31:57 user nova-compute[73503]:   </features>
Aug 26 13:31:57 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:31:57 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:31:57 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:31:57 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:31:57 user nova-compute[73503]:   </clock>
Aug 26 13:31:57 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:31:57 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:31:57 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:31:57 user nova-compute[73503]:   </cpu>
Aug 26 13:31:57 user nova-compute[73503]:   <devices>
Aug 26 13:31:57 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:31:57 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:31:57 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk"/>
Aug 26 13:31:57 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:31:57 user nova-compute[73503]:     </disk>
Aug 26 13:31:57 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:31:57 user nova-compute[73503]:       <mac address="fa:16:3e:cc:1f:5d"/>
Aug 26 13:31:57 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:57 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:31:57 user nova-compute[73503]:       <target dev="tapb3368fdc-ee"/>
Aug 26 13:31:57 user nova-compute[73503]:     </interface>
Aug 26 13:31:57 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:31:57 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/console.log" append="off"/>
Aug 26 13:31:57 user nova-compute[73503]:     </serial>
Aug 26 13:31:57 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:31:57 user nova-compute[73503]:     <video>
Aug 26 13:31:57 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:31:57 user nova-compute[73503]:     </video>
Aug 26 13:31:57 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:31:57 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:31:57 user nova-compute[73503]:     </rng>
Aug 26 13:31:57 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:31:57 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:31:57 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:31:57 user nova-compute[73503]:     </memballoon>
Aug 26 13:31:57 user nova-compute[73503]:   </devices>
Aug 26 13:31:57 user nova-compute[73503]: </domain>
Aug 26 13:31:57 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1377592966',display_name='tempest-VolumesNegativeTest-instance-1377592966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1377592966',id=41,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ac996d683ab4df38b492abdd8f9311f',ramdisk_id='',reservation_id='r-yjwatkcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1756260103',owner_user_name='tempest-VolumesNegativeTest-1756260103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:31:54Z,user_data=None,user_id='a769a9e32954483eb1ad16a225d3676a',uuid=edabb5ef-a0a9-44b5-b49e-7c4c24fb259b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Converting VIF {"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG os_vif [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3368fdc-ee, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3368fdc-ee, col_values=(('external_ids', {'iface-id': 'b3368fdc-ee03-4b93-9a40-ea68bf5703ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:1f:5d', 'vm-uuid': 'edabb5ef-a0a9-44b5-b49e-7c4c24fb259b'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:57 user nova-compute[73503]: INFO os_vif [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee')
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] No VIF found with MAC fa:16:3e:cc:1f:5d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updated VIF entry in instance network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] No waiting events found dispatching network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:57 user nova-compute[73503]: WARNING nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received unexpected event network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c for instance with vm_state active and task_state None.
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-changed-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.compute.manager [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Refreshing instance network info cache due to event network-changed-b3368fdc-ee03-4b93-9a40-ea68bf5703ff. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Acquiring lock "refresh_cache-edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Acquired lock "refresh_cache-edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG nova.network.neutron [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Refreshing network info cache for port b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:31:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Updated VIF entry in instance network info cache for port b3368fdc-ee03-4b93-9a40-ea68bf5703ff. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Updating instance_info_cache with network_info: [{"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d499dc1c-f7d2-48ab-92dd-5e8ba5a0ddf7 req-4d70e0c4-865b-4f2c-8ab3-2adc499c344a service nova] Releasing lock "refresh_cache-edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:59 user nova-compute[73503]: WARNING nova.compute.manager [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state building and task_state spawning.
Aug 26 13:31:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG nova.compute.manager [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:31:59 user nova-compute[73503]: WARNING nova.compute.manager [req-1ac9571e-ba0f-4c14-85b5-48069625d320 req-ef32fe8a-70b6-442e-91c0-03decec084b3 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state building and task_state spawning.
Aug 26 13:31:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:31:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-f606b19c-6f1a-43e7-b532-28d60a442261 req-1a759b08-cac3-47b1-9e6d-8ff4e87f8eca service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f606b19c-6f1a-43e7-b532-28d60a442261 req-1a759b08-cac3-47b1-9e6d-8ff4e87f8eca service nova] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f606b19c-6f1a-43e7-b532-28d60a442261 req-1a759b08-cac3-47b1-9e6d-8ff4e87f8eca service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f606b19c-6f1a-43e7-b532-28d60a442261 req-1a759b08-cac3-47b1-9e6d-8ff4e87f8eca service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-f606b19c-6f1a-43e7-b532-28d60a442261 req-1a759b08-cac3-47b1-9e6d-8ff4e87f8eca service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] No waiting events found dispatching network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:00 user nova-compute[73503]: WARNING nova.compute.manager [req-f606b19c-6f1a-43e7-b532-28d60a442261 req-1a759b08-cac3-47b1-9e6d-8ff4e87f8eca service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received unexpected event network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff for instance with vm_state building and task_state spawning.
Aug 26 13:32:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056721.6073194, 794e9828-4b77-4d11-84b8-5505e579949d => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Resumed (Lifecycle Event)
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance spawned successfully.
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056721.6085045, 794e9828-4b77-4d11-84b8-5505e579949d => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Started (Lifecycle Event)
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Took 9.90 seconds to spawn the instance on the hypervisor.
Aug 26 13:32:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:01 user nova-compute[73503]: INFO nova.compute.manager [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Took 10.79 seconds to build instance.
Aug 26 13:32:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0d91d011-7a11-4df7-b25f-2538f8d03a65 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.941s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d729d5a-1d7c-4f2b-867a-e14b0392458b req-ad252a48-21bf-4329-ad5a-ee038a4d4804 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d729d5a-1d7c-4f2b-867a-e14b0392458b req-ad252a48-21bf-4329-ad5a-ee038a4d4804 service nova] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d729d5a-1d7c-4f2b-867a-e14b0392458b req-ad252a48-21bf-4329-ad5a-ee038a4d4804 service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d729d5a-1d7c-4f2b-867a-e14b0392458b req-ad252a48-21bf-4329-ad5a-ee038a4d4804 service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d729d5a-1d7c-4f2b-867a-e14b0392458b req-ad252a48-21bf-4329-ad5a-ee038a4d4804 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] No waiting events found dispatching network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:02 user nova-compute[73503]: WARNING nova.compute.manager [req-6d729d5a-1d7c-4f2b-867a-e14b0392458b req-ad252a48-21bf-4329-ad5a-ee038a4d4804 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received unexpected event network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff for instance with vm_state building and task_state spawning.
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056722.4703135, edabb5ef-a0a9-44b5-b49e-7c4c24fb259b => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] VM Resumed (Lifecycle Event)
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Instance spawned successfully.
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056722.47323, edabb5ef-a0a9-44b5-b49e-7c4c24fb259b => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] VM Started (Lifecycle Event)
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Took 8.89 seconds to spawn the instance on the hypervisor.
Aug 26 13:32:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:02 user nova-compute[73503]: INFO nova.compute.manager [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Took 9.83 seconds to build instance.
Aug 26 13:32:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e0ad7bc-3c07-4492-8864-c7b8b34445b1 tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.951s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:08 user nova-compute[73503]: INFO nova.compute.manager [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Terminating instance
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-485d23f6-e5ab-4f6a-8c22-d1852725288b req-3533bc95-754e-44af-8a96-38b296487317 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-vif-unplugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-485d23f6-e5ab-4f6a-8c22-d1852725288b req-3533bc95-754e-44af-8a96-38b296487317 service nova] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-485d23f6-e5ab-4f6a-8c22-d1852725288b req-3533bc95-754e-44af-8a96-38b296487317 service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-485d23f6-e5ab-4f6a-8c22-d1852725288b req-3533bc95-754e-44af-8a96-38b296487317 service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-485d23f6-e5ab-4f6a-8c22-d1852725288b req-3533bc95-754e-44af-8a96-38b296487317 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] No waiting events found dispatching network-vif-unplugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-485d23f6-e5ab-4f6a-8c22-d1852725288b req-3533bc95-754e-44af-8a96-38b296487317 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-vif-unplugged-6c8499ac-a7b3-4817-af36-231c4102f096 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:32:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Instance destroyed successfully.
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'resources' on Instance uuid dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:27:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1183160188',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1183160188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1183160188',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyFSR9jBkhPHasPe+Y1rlj+6EA9qlUH6X+HyASC0UydxolGH/UXEdt1G4I5hg6+vQfTe40GpujaS2NQXDI6ilThqQMNKUYDFCkS/2OhBuWMpdjwthAIAHt9LBYQYfLrhw==',key_name='tempest-keypair-1394029504',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:27:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-w9k2pvd5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122b92a79d3242f2903b15430240eace',uuid=dadd3a5c-6441-4dbb-ba1a-54bcadeccb44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "6c8499ac-a7b3-4817-af36-231c4102f096", "address": "fa:16:3e:7e:ed:96", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c8499ac-a7", "ovs_interfaceid": "6c8499ac-a7b3-4817-af36-231c4102f096", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG os_vif [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c8499ac-a7, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:08 user nova-compute[73503]: INFO os_vif [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:ed:96,bridge_name='br-int',has_traffic_filtering=True,id=6c8499ac-a7b3-4817-af36-231c4102f096,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c8499ac-a7')
Aug 26 13:32:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPuADoiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:32:08 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:32:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:32:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d222c69-95d1-4dce-a51b-7ecd3965d691]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c1a01-4d51-45f4-acb9-ca13d2116a1e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:32:09 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:32:09 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:32:09 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:32:09 user nova-compute[73503]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 (non-flash)
Aug 26 13:32:09 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:32:09 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3045aae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc47ab3-176a-4e57-814c-26c06abaae8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b2326b-48d1-41a7-b16c-97c82d2e4dc4]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2849585-4a20-4d13-a7d1-b15b56fcfe43]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b32b71-b0a7-4015-ae32-966e059abb97]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5fbdd148-3b21519ada1f5372', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5fbdd148', '/dev/disk/by-id/scsi-23362323135313961') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b76204-045e-4168-8551-7cdb9a39b0e6]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4cf9a6-61f4-44fc-b3a4-11c33ad8cefe]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b934e20b-3f7e-4199-b627-7f9eeebc9cf9]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260]
Aug 26 13:32:09 user nova-compute[73503]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5, portal: 172.16.0.220,3260] successful.
Aug 26 13:32:09 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:967b3c6b-66f8-4197-a9f8-de8ee96426c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae816e45-c4aa-41f4-a0ec-b4b2fdae5fe7]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== disconnect_volume: return (317ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:32:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Deleting instance files /opt/stack/data/nova/instances/dadd3a5c-6441-4dbb-ba1a-54bcadeccb44_del
Aug 26 13:32:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Deletion of /opt/stack/data/nova/instances/dadd3a5c-6441-4dbb-ba1a-54bcadeccb44_del complete
Aug 26 13:32:09 user nova-compute[73503]: INFO nova.compute.manager [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 13:32:09 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:32:09 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:32:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-2b9cd9a2-2282-4f02-963d-bdae6d63c4b9 req-1c21c78f-e2d2-4d9a-a21e-1b946686debc service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2b9cd9a2-2282-4f02-963d-bdae6d63c4b9 req-1c21c78f-e2d2-4d9a-a21e-1b946686debc service nova] Acquiring lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2b9cd9a2-2282-4f02-963d-bdae6d63c4b9 req-1c21c78f-e2d2-4d9a-a21e-1b946686debc service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2b9cd9a2-2282-4f02-963d-bdae6d63c4b9 req-1c21c78f-e2d2-4d9a-a21e-1b946686debc service nova] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-2b9cd9a2-2282-4f02-963d-bdae6d63c4b9 req-1c21c78f-e2d2-4d9a-a21e-1b946686debc service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] No waiting events found dispatching network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:10 user nova-compute[73503]: WARNING nova.compute.manager [req-2b9cd9a2-2282-4f02-963d-bdae6d63c4b9 req-1c21c78f-e2d2-4d9a-a21e-1b946686debc service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received unexpected event network-vif-plugged-6c8499ac-a7b3-4817-af36-231c4102f096 for instance with vm_state active and task_state deleting.
Aug 26 13:32:10 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-453338b0-6651-44d7-9b27-28a5f33324ce req-d6fb81df-a2c0-4eba-be9a-f9d5945b1a03 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Received event network-vif-deleted-6c8499ac-a7b3-4817-af36-231c4102f096 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:10 user nova-compute[73503]: INFO nova.compute.manager [req-453338b0-6651-44d7-9b27-28a5f33324ce req-d6fb81df-a2c0-4eba-be9a-f9d5945b1a03 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Neutron deleted interface 6c8499ac-a7b3-4817-af36-231c4102f096; detaching it from the instance and deleting it from the info cache
Aug 26 13:32:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-453338b0-6651-44d7-9b27-28a5f33324ce req-d6fb81df-a2c0-4eba-be9a-f9d5945b1a03 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:10 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Took 1.26 seconds to deallocate network for instance.
Aug 26 13:32:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-453338b0-6651-44d7-9b27-28a5f33324ce req-d6fb81df-a2c0-4eba-be9a-f9d5945b1a03 service nova] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Detach interface failed, port_id=6c8499ac-a7b3-4817-af36-231c4102f096, reason: Instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:32:11 user nova-compute[73503]: INFO nova.compute.manager [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 13:32:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Deleting volume: 967b3c6b-66f8-4197-a9f8-de8ee96426c5 {{(pid=73503) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 13:32:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:11 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:32:11 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:32:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:12 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Deleted allocations for instance dadd3a5c-6441-4dbb-ba1a-54bcadeccb44
Aug 26 13:32:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a2f999d-2181-41c9-9285-04072203ff80 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dadd3a5c-6441-4dbb-ba1a-54bcadeccb44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.987s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:13 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:14 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:17 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:32:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:32:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:32:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid 45a45e79-86a3-40a8-96bc-7437cf769580 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:32:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [{"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-45a45e79-86a3-40a8-96bc-7437cf769580" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:32:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:32:23 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056728.9312286, dadd3a5c-6441-4dbb-ba1a-54bcadeccb44 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:23 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] VM Stopped (Lifecycle Event)
Aug 26 13:32:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7edfac2c-a2b9-4eb5-99d1-c99dd73db855 None None] [instance: dadd3a5c-6441-4dbb-ba1a-54bcadeccb44] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:32:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:32:27 user nova-compute[73503]: INFO nova.compute.claims [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Claim successful on node user
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:32:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.policy [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8239f95979394225b8c80579a8121631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e80f2c62e0a4494816b02e60073bb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:32:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Creating image(s)
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "/opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk 1073741824" returned: 0 in 0.048s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Successfully created port: 42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Cannot resize image /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Ensure instance console log exists: /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Successfully updated port: 42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquired lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-changed-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Refreshing instance network info cache due to event network-changed-42d01d63-729f-4a4a-aa65-c20715619d37. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] Acquiring lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updating instance_info_cache with network_info: [{"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Releasing lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Instance network_info: |[{"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] Acquired lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.neutron [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Refreshing network info cache for port 42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Start _get_guest_xml network_info=[{"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:32:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:32:29 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109442013',display_name='tempest-AttachVolumeNegativeTest-server-109442013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109442013',id=42,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuk2RlhbZaz7IP9BN5xUpj8xWgmkzkhkHeOhwAb6NR/jHV4Q7bOPrv6GndPxJMwPhw2HPmefdEzznxneYpGNTfaI8hehpJCam+tzLGPJyxjOkP8R7jJ5q97IvEWUm2Z/A==',key_name='tempest-keypair-1875760510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-482gq5w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=0f52dfe3-0414-40eb-8958-8c73dab19ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f52dfe3-0414-40eb-8958-8c73dab19ff2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:32:29 user nova-compute[73503]:   <uuid>0f52dfe3-0414-40eb-8958-8c73dab19ff2</uuid>
Aug 26 13:32:29 user nova-compute[73503]:   <name>instance-0000002a</name>
Aug 26 13:32:29 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:32:29 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:32:29 user nova-compute[73503]:   <metadata>
Aug 26 13:32:29 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:32:29 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:32:29 user nova-compute[73503]:       <nova:name>tempest-AttachVolumeNegativeTest-server-109442013</nova:name>
Aug 26 13:32:29 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:32:29</nova:creationTime>
Aug 26 13:32:29 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:32:29 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:32:29 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:32:29 user nova-compute[73503]:       <nova:owner>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:user uuid="8239f95979394225b8c80579a8121631">tempest-AttachVolumeNegativeTest-2059589668-project-member</nova:user>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:project uuid="3e80f2c62e0a4494816b02e60073bb0e">tempest-AttachVolumeNegativeTest-2059589668</nova:project>
Aug 26 13:32:29 user nova-compute[73503]:       </nova:owner>
Aug 26 13:32:29 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:32:29 user nova-compute[73503]:       <nova:ports>
Aug 26 13:32:29 user nova-compute[73503]:         <nova:port uuid="42d01d63-729f-4a4a-aa65-c20715619d37">
Aug 26 13:32:29 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:32:29 user nova-compute[73503]:         </nova:port>
Aug 26 13:32:29 user nova-compute[73503]:       </nova:ports>
Aug 26 13:32:29 user nova-compute[73503]:     </nova:instance>
Aug 26 13:32:29 user nova-compute[73503]:   </metadata>
Aug 26 13:32:29 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:32:29 user nova-compute[73503]:     <system>
Aug 26 13:32:29 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:32:29 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:32:29 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:32:29 user nova-compute[73503]:       <entry name="serial">0f52dfe3-0414-40eb-8958-8c73dab19ff2</entry>
Aug 26 13:32:29 user nova-compute[73503]:       <entry name="uuid">0f52dfe3-0414-40eb-8958-8c73dab19ff2</entry>
Aug 26 13:32:29 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:32:29 user nova-compute[73503]:     </system>
Aug 26 13:32:29 user nova-compute[73503]:   </sysinfo>
Aug 26 13:32:29 user nova-compute[73503]:   <os>
Aug 26 13:32:29 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:32:29 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:32:29 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:32:29 user nova-compute[73503]:   </os>
Aug 26 13:32:29 user nova-compute[73503]:   <features>
Aug 26 13:32:29 user nova-compute[73503]:     <acpi/>
Aug 26 13:32:29 user nova-compute[73503]:     <apic/>
Aug 26 13:32:29 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:32:29 user nova-compute[73503]:   </features>
Aug 26 13:32:29 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:32:29 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:32:29 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:32:29 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:32:29 user nova-compute[73503]:   </clock>
Aug 26 13:32:29 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:32:29 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:32:29 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:32:29 user nova-compute[73503]:   </cpu>
Aug 26 13:32:29 user nova-compute[73503]:   <devices>
Aug 26 13:32:29 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:32:29 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:32:29 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk"/>
Aug 26 13:32:29 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:32:29 user nova-compute[73503]:     </disk>
Aug 26 13:32:29 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:32:29 user nova-compute[73503]:       <mac address="fa:16:3e:b1:cd:e5"/>
Aug 26 13:32:29 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:32:29 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:32:29 user nova-compute[73503]:       <target dev="tap42d01d63-72"/>
Aug 26 13:32:29 user nova-compute[73503]:     </interface>
Aug 26 13:32:29 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:32:29 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/console.log" append="off"/>
Aug 26 13:32:29 user nova-compute[73503]:     </serial>
Aug 26 13:32:29 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:32:29 user nova-compute[73503]:     <video>
Aug 26 13:32:29 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:32:29 user nova-compute[73503]:     </video>
Aug 26 13:32:29 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:32:29 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:32:29 user nova-compute[73503]:     </rng>
Aug 26 13:32:29 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:32:29 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:32:29 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:32:29 user nova-compute[73503]:     </memballoon>
Aug 26 13:32:29 user nova-compute[73503]:   </devices>
Aug 26 13:32:29 user nova-compute[73503]: </domain>
Aug 26 13:32:29 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109442013',display_name='tempest-AttachVolumeNegativeTest-server-109442013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109442013',id=42,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuk2RlhbZaz7IP9BN5xUpj8xWgmkzkhkHeOhwAb6NR/jHV4Q7bOPrv6GndPxJMwPhw2HPmefdEzznxneYpGNTfaI8hehpJCam+tzLGPJyxjOkP8R7jJ5q97IvEWUm2Z/A==',key_name='tempest-keypair-1875760510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-482gq5w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:32:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=0f52dfe3-0414-40eb-8958-8c73dab19ff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG os_vif [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42d01d63-72, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42d01d63-72, col_values=(('external_ids', {'iface-id': '42d01d63-729f-4a4a-aa65-c20715619d37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:cd:e5', 'vm-uuid': '0f52dfe3-0414-40eb-8958-8c73dab19ff2'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:29 user nova-compute[73503]: INFO os_vif [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72')
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:b1:cd:e5, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:32:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056753.1796286, 0f52dfe3-0414-40eb-8958-8c73dab19ff2 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] VM Resumed (Lifecycle Event)
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-6fc2e806-8437-429e-bd76-c14d4fc1315b req-547976ab-c81a-4f51-b968-62aa36829da4 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6fc2e806-8437-429e-bd76-c14d4fc1315b req-547976ab-c81a-4f51-b968-62aa36829da4 service nova] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6fc2e806-8437-429e-bd76-c14d4fc1315b req-547976ab-c81a-4f51-b968-62aa36829da4 service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6fc2e806-8437-429e-bd76-c14d4fc1315b req-547976ab-c81a-4f51-b968-62aa36829da4 service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-6fc2e806-8437-429e-bd76-c14d4fc1315b req-547976ab-c81a-4f51-b968-62aa36829da4 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] No waiting events found dispatching network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:33 user nova-compute[73503]: WARNING nova.compute.manager [req-6fc2e806-8437-429e-bd76-c14d4fc1315b req-547976ab-c81a-4f51-b968-62aa36829da4 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received unexpected event network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 for instance with vm_state building and task_state spawning.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-f0359f2d-9cb9-4380-9f81-cb43952767e6 req-3f227d01-5960-451e-aae8-4a0f309bf2af service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f0359f2d-9cb9-4380-9f81-cb43952767e6 req-3f227d01-5960-451e-aae8-4a0f309bf2af service nova] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f0359f2d-9cb9-4380-9f81-cb43952767e6 req-3f227d01-5960-451e-aae8-4a0f309bf2af service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f0359f2d-9cb9-4380-9f81-cb43952767e6 req-3f227d01-5960-451e-aae8-4a0f309bf2af service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-f0359f2d-9cb9-4380-9f81-cb43952767e6 req-3f227d01-5960-451e-aae8-4a0f309bf2af service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] No waiting events found dispatching network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:33 user nova-compute[73503]: WARNING nova.compute.manager [req-f0359f2d-9cb9-4380-9f81-cb43952767e6 req-3f227d01-5960-451e-aae8-4a0f309bf2af service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received unexpected event network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 for instance with vm_state building and task_state spawning.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:33 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:32:33 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7360MB free_disk=24.813575744628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Instance spawned successfully.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056753.1821215, 0f52dfe3-0414-40eb-8958-8c73dab19ff2 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] VM Started (Lifecycle Event)
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.network.neutron [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updated VIF entry in instance network info cache for port 42d01d63-729f-4a4a-aa65-c20715619d37. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.network.neutron [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updating instance_info_cache with network_info: [{"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-23ef0c81-c6a3-40c8-bec0-cefbdfefeb8e req-a8fdb714-1f20-488b-a54e-da23aa74e052 service nova] Releasing lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5d626cfa-cc85-452f-b0a5-a78866419404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 77eb9676-06b7-4a3e-b6cc-58cec7b907dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance edabb5ef-a0a9-44b5-b49e-7c4c24fb259b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:32:33 user nova-compute[73503]: INFO nova.compute.manager [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Took 6.89 seconds to build instance.
Aug 26 13:32:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a5feeeb3-a184-48c3-b1a0-36c79357b576 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.999s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:33 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:32:34 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:32:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:32:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:32:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:32:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-changed-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Refreshing instance network info cache due to event network-changed-7fbcd820-0de2-4247-bab7-a129479abf98. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] Acquiring lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] Acquired lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Refreshing network info cache for port 7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'flavor' on Instance uuid 5d626cfa-cc85-452f-b0a5-a78866419404 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:32:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Ignoring supplied device name: /dev/vdb
Aug 26 13:32:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:45 user nova-compute[73503]: INFO nova.compute.manager [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Attaching volume 0433f466-10b5-407e-b1b8-9c0ef081a58f to /dev/vdb
Aug 26 13:32:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updated VIF entry in instance network info cache for port 7fbcd820-0de2-4247-bab7-a129479abf98. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updating instance_info_cache with network_info: [{"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-65457606-e4df-4f4a-9f7e-1af16ad2aecf req-d7b1cd91-3cad-4294-9dc1-58034809f2e5 service nova] Releasing lock "refresh_cache-5d626cfa-cc85-452f-b0a5-a78866419404" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG os_brick.utils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a0fe19-25df-41c4-926e-1ad5e326687b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adbf923-506d-441b-90ee-a5d01e9ed771]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75d893b-3e5a-4af9-abff-5f450ca9b921]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd118605-4386-4ce6-bfd4-3eaaf5718bee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:32:45 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:32:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f217305d-ff34-4fb6-bd00-99482d534e7b]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG os_brick.utils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:32:45 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updating existing volume attachment record: 4ae9a574-1a01-47c6-a7e9-8d3df47c6709 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:32:47 user nova-compute[73503]: INFO nova.compute.manager [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Unrescuing
Aug 26 13:32:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:32:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquired lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:32:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating instance_info_cache with network_info: [{"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Releasing lock "refresh_cache-1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'flavor' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-214dd916-4100-4b52-a8bd-0aa51e317a0a req-183f9476-f6cf-4ff4-8a99-a3c5a823c594 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-214dd916-4100-4b52-a8bd-0aa51e317a0a req-183f9476-f6cf-4ff4-8a99-a3c5a823c594 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-214dd916-4100-4b52-a8bd-0aa51e317a0a req-183f9476-f6cf-4ff4-8a99-a3c5a823c594 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-214dd916-4100-4b52-a8bd-0aa51e317a0a req-183f9476-f6cf-4ff4-8a99-a3c5a823c594 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG nova.compute.manager [req-214dd916-4100-4b52-a8bd-0aa51e317a0a req-183f9476-f6cf-4ff4-8a99-a3c5a823c594 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:48 user nova-compute[73503]: WARNING nova.compute.manager [req-214dd916-4100-4b52-a8bd-0aa51e317a0a req-183f9476-f6cf-4ff4-8a99-a3c5a823c594 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:32:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance destroyed successfully.
Aug 26 13:32:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:50 user nova-compute[73503]: WARNING nova.compute.manager [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:32:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:50 user nova-compute[73503]: WARNING nova.compute.manager [req-d7944f9b-e42f-487f-a969-3ac69e2c6778 req-c324550d-8fcf-4568-82bd-c6ed3eda9f97 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:32:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056772.7106724, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Resumed (Lifecycle Event)
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-89088691-0165-42c8-bc4e-33c75b6c9b13 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056772.712379, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:32:52 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Started (Lifecycle Event)
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-a4e4ac18-277b-496a-8502-efdefb0d9aee req-142bdf24-a7d9-408e-a305-cb8842c4766e service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a4e4ac18-277b-496a-8502-efdefb0d9aee req-142bdf24-a7d9-408e-a305-cb8842c4766e service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a4e4ac18-277b-496a-8502-efdefb0d9aee req-142bdf24-a7d9-408e-a305-cb8842c4766e service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a4e4ac18-277b-496a-8502-efdefb0d9aee req-142bdf24-a7d9-408e-a305-cb8842c4766e service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-a4e4ac18-277b-496a-8502-efdefb0d9aee req-142bdf24-a7d9-408e-a305-cb8842c4766e service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:32:52 user nova-compute[73503]: WARNING nova.compute.manager [req-a4e4ac18-277b-496a-8502-efdefb0d9aee req-142bdf24-a7d9-408e-a305-cb8842c4766e service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:32:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:32:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBSoZjUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:32:56 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:32:56 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:32:56 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddda050-5796-4e9d-9f45-5d3feb94cf77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:32:56 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[854263fb-abd0-4009-a4dd-ebaf0cb28254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f] added
Aug 26 13:32:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad5e2a-b6bc-4016-9c1f-77a2c136ce55]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b5452d-15cf-4a04-bf7a-07af98f7778f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBSoZjUy {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QBSoZjUy" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[273ef639-27de-417a-8eee-2571b54a8fb3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QBSoZjUy'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a9fc6-0e38-422b-99ce-a8adbe319dd6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b1ab0a-92ea-41ac-a156-8b3626b61b55]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:32:56 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:32:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:32:56 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:32:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a361d9-f5ec-406c-b9b4-872d6982589a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260]
Aug 26 13:32:56 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260] successful.
Aug 26 13:32:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[31acae01-de82-4433-9e01-27b0dace2b2f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a1e91-306f-4cc6-a805-a7f9f34a438c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:32:56 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:32:56 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:32:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:32:56 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:32:56 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:32:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c228be-0f3f-4a38-aaa8-73ff6f0dd313]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:32:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBSoZjUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23634313365633536', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634313365633536', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG nova.objects.instance [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'flavor' on Instance uuid 5d626cfa-cc85-452f-b0a5-a78866419404 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:32:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:32:57 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:32:57 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:32:57 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:32:57 user nova-compute[73503]:   <serial>0433f466-10b5-407e-b1b8-9c0ef081a58f</serial>
Aug 26 13:32:57 user nova-compute[73503]: </disk>
Aug 26 13:32:57 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:32:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:32:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:32:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No VIF found with MAC fa:16:3e:87:4e:42, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:32:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:32:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-3d4ee8c6-f6fc-4d66-ba07-52a92e2b279a tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.113s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:32:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "a851a51f-69aa-4580-bc92-f23485b352eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:33:13 user nova-compute[73503]: INFO nova.compute.claims [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Claim successful on node user
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:33:14 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:33:14 user nova-compute[73503]: INFO nova.virt.block_device [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Booting with volume 772e71f4-cbf8-4639-ad90-bc0b488454f2 at /dev/vda
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.policy [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122b92a79d3242f2903b15430240eace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c42bf18354f55954102eed4da2d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG os_brick.utils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f29bbf5-4cd3-4408-9062-47744a8dc557]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b306f-6884-4d79-92c5-4d244227d8da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[38efeb7e-dfb9-4b5e-923d-d25538652153]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763c7da-8b45-4540-9b0e-922c7065b452]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:33:14 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:33:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[660a3868-4aab-4c7f-827a-9b103d63080c]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG os_brick.utils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updating existing volume attachment record: 080ca4e4-364c-4be8-8211-e4d53d18924e {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:33:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Successfully created port: ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:33:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Successfully updated port: ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:33:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:33:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquired lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:33:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-changed-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.compute.manager [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Refreshing instance network info cache due to event network-changed-ff13ce03-00ec-46df-b963-127cea573a4b. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] Acquiring lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.network.neutron [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updating instance_info_cache with network_info: [{"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Releasing lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Instance network_info: |[{"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] Acquired lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Refreshing network info cache for port ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updated VIF entry in instance network info cache for port ff13ce03-00ec-46df-b963-127cea573a4b. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG nova.network.neutron [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updating instance_info_cache with network_info: [{"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b241eef5-0fc4-44bf-8ca2-18f7780d2ceb req-24a205bf-9617-4b59-8274-c72587cfd9fe service nova] Releasing lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:33:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:33:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:33:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:33:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:33:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:33:25 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [{"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-6472acd9-81af-48fe-9650-0cfb8146dbd0" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:33:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:33:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Creating image(s)
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Ensure instance console log exists: /opt/stack/data/nova/instances/a851a51f-69aa-4580-bc92-f23485b352eb/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Start _get_guest_xml network_info=[{"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a851a51f-69aa-4580-bc92-f23485b352eb', 'attached_at': '', 'detached_at': '', 'volume_id': '772e71f4-cbf8-4639-ad90-bc0b488454f2', 'serial': '772e71f4-cbf8-4639-ad90-bc0b488454f2'}, 'attachment_id': '080ca4e4-364c-4be8-8211-e4d53d18924e', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:33:26 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:33:26 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:33:26 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:33:26 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:33:26 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[03542c9c-726b-4961-8026-9194e5653069]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:33:26 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: INFO nova.compute.manager [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Terminating instance
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e565678-7cee-4bec-9c2b-96115daa0d37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2] added
Aug 26 13:33:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed747f0a-1705-421e-aa6f-10bfc0f40350]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df24eda-c1b0-45f7-b387-d5a2a3f2024c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIjrtcqV {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIjrtcqV" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01c7a51-b01d-40b1-95f8-101ef9e681af]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIjrtcqV'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d1f708-0aba-47bf-8c7b-9d385c4f4d4f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e7076c-1799-4789-b878-f37c52b35521]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:33:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:33:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207d4d7-0bc6-4abe-9026-8bf7a057a4f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]
Aug 26 13:33:26 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.
Aug 26 13:33:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2278820-873d-4b05-9e05-0b5a47e4aba4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-221cb2d8-2559-4eab-b3c5-50976fc5ba4b req-dff441e6-57d2-449e-967d-3102e3a41640 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-vif-unplugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-221cb2d8-2559-4eab-b3c5-50976fc5ba4b req-dff441e6-57d2-449e-967d-3102e3a41640 service nova] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-221cb2d8-2559-4eab-b3c5-50976fc5ba4b req-dff441e6-57d2-449e-967d-3102e3a41640 service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-221cb2d8-2559-4eab-b3c5-50976fc5ba4b req-dff441e6-57d2-449e-967d-3102e3a41640 service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-221cb2d8-2559-4eab-b3c5-50976fc5ba4b req-dff441e6-57d2-449e-967d-3102e3a41640 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] No waiting events found dispatching network-vif-unplugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-221cb2d8-2559-4eab-b3c5-50976fc5ba4b req-dff441e6-57d2-449e-967d-3102e3a41640 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-vif-unplugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df99773-98ab-4fe7-a008-f14fcde6b8de]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:33:26 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:26 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b068c7-0a77-4f4a-bdc0-7b6b2edfa8d7]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Instance destroyed successfully.
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.objects.instance [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lazy-loading 'resources' on Instance uuid 77eb9676-06b7-4a3e-b6cc-58cec7b907dc {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1545092434',display_name='tempest-VolumesActionsTest-instance-1545092434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1545092434',id=38,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:31:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4528507d2e6a4599b81db97d0f3bc0b0',ramdisk_id='',reservation_id='r-2sv435da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2093075288',owner_user_name='tempest-VolumesActionsTest-2093075288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:31:43Z,user_data=None,user_id='45fe9e01c207444aa5480a6e4ddd480a',uuid=77eb9676-06b7-4a3e-b6cc-58cec7b907dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converting VIF {"id": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "address": "fa:16:3e:86:5e:98", "network": {"id": "9d4dea93-35dc-4d37-8e2d-7fda982da90a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-899544474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4528507d2e6a4599b81db97d0f3bc0b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8650ea6d-da", "ovs_interfaceid": "8650ea6d-dada-4add-a010-43a5e29ae4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG os_vif [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8650ea6d-da, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:33:26 user nova-compute[73503]: INFO os_vif [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:5e:98,bridge_name='br-int',has_traffic_filtering=True,id=8650ea6d-dada-4add-a010-43a5e29ae4f8,network=Network(9d4dea93-35dc-4d37-8e2d-7fda982da90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8650ea6d-da')
Aug 26 13:33:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Deleting instance files /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc_del
Aug 26 13:33:26 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Deletion of /opt/stack/data/nova/instances/77eb9676-06b7-4a3e-b6cc-58cec7b907dc_del complete
Aug 26 13:33:26 user nova-compute[73503]: INFO nova.compute.manager [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 26 13:33:26 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:33:26 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:27 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Took 0.46 seconds to deallocate network for instance.
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-5b7c66ac-2a8b-4d91-a7bb-030e64bb0c96 req-77d9b119-cff6-4c2e-abba-3d94c39c2378 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-vif-deleted-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:27 user nova-compute[73503]: INFO nova.compute.manager [req-5b7c66ac-2a8b-4d91-a7bb-030e64bb0c96 req-77d9b119-cff6-4c2e-abba-3d94c39c2378 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Neutron deleted interface 8650ea6d-dada-4add-a010-43a5e29ae4f8; detaching it from the instance and deleting it from the info cache
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.network.neutron [req-5b7c66ac-2a8b-4d91-a7bb-030e64bb0c96 req-77d9b119-cff6-4c2e-abba-3d94c39c2378 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-5b7c66ac-2a8b-4d91-a7bb-030e64bb0c96 req-77d9b119-cff6-4c2e-abba-3d94c39c2378 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Detach interface failed, port_id=8650ea6d-dada-4add-a010-43a5e29ae4f8, reason: Instance 77eb9676-06b7-4a3e-b6cc-58cec7b907dc could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23333303639383838', 'path': '/dev/sdd'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333303639383838', 'path': '/dev/sdd'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988599469',display_name='tempest-TestVolumeBootPattern-server-1988599469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988599469',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-f03ust3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:33:14Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=a851a51f-69aa-4580-bc92-f23485b352eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'pci_devices' on Instance uuid a851a51f-69aa-4580-bc92-f23485b352eb {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:33:27 user nova-compute[73503]:   <uuid>a851a51f-69aa-4580-bc92-f23485b352eb</uuid>
Aug 26 13:33:27 user nova-compute[73503]:   <name>instance-0000002b</name>
Aug 26 13:33:27 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:33:27 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:33:27 user nova-compute[73503]:   <metadata>
Aug 26 13:33:27 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:33:27 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:33:27 user nova-compute[73503]:       <nova:name>tempest-TestVolumeBootPattern-server-1988599469</nova:name>
Aug 26 13:33:27 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:33:26</nova:creationTime>
Aug 26 13:33:27 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:33:27 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:33:27 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:33:27 user nova-compute[73503]:       <nova:owner>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:user uuid="122b92a79d3242f2903b15430240eace">tempest-TestVolumeBootPattern-813053503-project-member</nova:user>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:project uuid="c56c42bf18354f55954102eed4da2d58">tempest-TestVolumeBootPattern-813053503</nova:project>
Aug 26 13:33:27 user nova-compute[73503]:       </nova:owner>
Aug 26 13:33:27 user nova-compute[73503]:       <nova:ports>
Aug 26 13:33:27 user nova-compute[73503]:         <nova:port uuid="ff13ce03-00ec-46df-b963-127cea573a4b">
Aug 26 13:33:27 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 13:33:27 user nova-compute[73503]:         </nova:port>
Aug 26 13:33:27 user nova-compute[73503]:       </nova:ports>
Aug 26 13:33:27 user nova-compute[73503]:     </nova:instance>
Aug 26 13:33:27 user nova-compute[73503]:   </metadata>
Aug 26 13:33:27 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:33:27 user nova-compute[73503]:     <system>
Aug 26 13:33:27 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:33:27 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:33:27 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:33:27 user nova-compute[73503]:       <entry name="serial">a851a51f-69aa-4580-bc92-f23485b352eb</entry>
Aug 26 13:33:27 user nova-compute[73503]:       <entry name="uuid">a851a51f-69aa-4580-bc92-f23485b352eb</entry>
Aug 26 13:33:27 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:33:27 user nova-compute[73503]:     </system>
Aug 26 13:33:27 user nova-compute[73503]:   </sysinfo>
Aug 26 13:33:27 user nova-compute[73503]:   <os>
Aug 26 13:33:27 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:33:27 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:33:27 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:33:27 user nova-compute[73503]:   </os>
Aug 26 13:33:27 user nova-compute[73503]:   <features>
Aug 26 13:33:27 user nova-compute[73503]:     <acpi/>
Aug 26 13:33:27 user nova-compute[73503]:     <apic/>
Aug 26 13:33:27 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:33:27 user nova-compute[73503]:   </features>
Aug 26 13:33:27 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:33:27 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:33:27 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:33:27 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:33:27 user nova-compute[73503]:   </clock>
Aug 26 13:33:27 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:33:27 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:33:27 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:33:27 user nova-compute[73503]:   </cpu>
Aug 26 13:33:27 user nova-compute[73503]:   <devices>
Aug 26 13:33:27 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:33:27 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:33:27 user nova-compute[73503]:       <source dev="/dev/sdd"/>
Aug 26 13:33:27 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:33:27 user nova-compute[73503]:       <serial>772e71f4-cbf8-4639-ad90-bc0b488454f2</serial>
Aug 26 13:33:27 user nova-compute[73503]:     </disk>
Aug 26 13:33:27 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:33:27 user nova-compute[73503]:       <mac address="fa:16:3e:53:65:c5"/>
Aug 26 13:33:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:33:27 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:33:27 user nova-compute[73503]:       <target dev="tapff13ce03-00"/>
Aug 26 13:33:27 user nova-compute[73503]:     </interface>
Aug 26 13:33:27 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:33:27 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/a851a51f-69aa-4580-bc92-f23485b352eb/console.log" append="off"/>
Aug 26 13:33:27 user nova-compute[73503]:     </serial>
Aug 26 13:33:27 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:33:27 user nova-compute[73503]:     <video>
Aug 26 13:33:27 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:33:27 user nova-compute[73503]:     </video>
Aug 26 13:33:27 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:33:27 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:33:27 user nova-compute[73503]:     </rng>
Aug 26 13:33:27 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:33:27 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:33:27 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:33:27 user nova-compute[73503]:     </memballoon>
Aug 26 13:33:27 user nova-compute[73503]:   </devices>
Aug 26 13:33:27 user nova-compute[73503]: </domain>
Aug 26 13:33:27 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988599469',display_name='tempest-TestVolumeBootPattern-server-1988599469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988599469',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-f03ust3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:33:14Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=a851a51f-69aa-4580-bc92-f23485b352eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG os_vif [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff13ce03-00, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff13ce03-00, col_values=(('external_ids', {'iface-id': 'ff13ce03-00ec-46df-b963-127cea573a4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:65:c5', 'vm-uuid': 'a851a51f-69aa-4580-bc92-f23485b352eb'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:27 user nova-compute[73503]: INFO os_vif [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00')
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No VIF found with MAC fa:16:3e:53:65:c5, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:33:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:27 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Deleted allocations for instance 77eb9676-06b7-4a3e-b6cc-58cec7b907dc
Aug 26 13:33:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2c05a848-4d8c-4573-a1a3-1d79e0bbdca5 tempest-VolumesActionsTest-2093075288 tempest-VolumesActionsTest-2093075288-project-member] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-9553785e-0e69-4492-a668-28c3dda79d92 req-1556e6a9-4270-47ad-a6b8-6d6c03efc745 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received event network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9553785e-0e69-4492-a668-28c3dda79d92 req-1556e6a9-4270-47ad-a6b8-6d6c03efc745 service nova] Acquiring lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9553785e-0e69-4492-a668-28c3dda79d92 req-1556e6a9-4270-47ad-a6b8-6d6c03efc745 service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9553785e-0e69-4492-a668-28c3dda79d92 req-1556e6a9-4270-47ad-a6b8-6d6c03efc745 service nova] Lock "77eb9676-06b7-4a3e-b6cc-58cec7b907dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-9553785e-0e69-4492-a668-28c3dda79d92 req-1556e6a9-4270-47ad-a6b8-6d6c03efc745 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] No waiting events found dispatching network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:28 user nova-compute[73503]: WARNING nova.compute.manager [req-9553785e-0e69-4492-a668-28c3dda79d92 req-1556e6a9-4270-47ad-a6b8-6d6c03efc745 service nova] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Received unexpected event network-vif-plugged-8650ea6d-dada-4add-a010-43a5e29ae4f8 for instance with vm_state deleted and task_state None.
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:33:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] No waiting events found dispatching network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:30 user nova-compute[73503]: WARNING nova.compute.manager [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received unexpected event network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b for instance with vm_state building and task_state spawning.
Aug 26 13:33:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] No waiting events found dispatching network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:30 user nova-compute[73503]: WARNING nova.compute.manager [req-fddb106f-2be1-4ead-b776-81f6cc7ffbd5 req-20d80d45-d7b0-4f12-825d-f6c51a59d5e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received unexpected event network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b for instance with vm_state building and task_state spawning.
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056811.0015054, a851a51f-69aa-4580-bc92-f23485b352eb => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] VM Resumed (Lifecycle Event)
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Instance spawned successfully.
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056811.0081875, a851a51f-69aa-4580-bc92-f23485b352eb => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] VM Started (Lifecycle Event)
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Took 5.04 seconds to spawn the instance on the hypervisor.
Aug 26 13:33:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:31 user nova-compute[73503]: INFO nova.compute.manager [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Took 17.51 seconds to build instance.
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c777264b-16ed-4532-9104-cd8afe1e355a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "a851a51f-69aa-4580-bc92-f23485b352eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.630s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:32 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:33:32 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7438MB free_disk=24.809146881103516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 5d626cfa-cc85-452f-b0a5-a78866419404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance edabb5ef-a0a9-44b5-b49e-7c4c24fb259b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance a851a51f-69aa-4580-bc92-f23485b352eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:33:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:33:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:33 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:33:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:33:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:33:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-changed-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Refreshing instance network info cache due to event network-changed-329285b3-6416-41f9-92d6-aef1de3c371c. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:33:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] Acquiring lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:33:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] Acquired lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:33:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Refreshing network info cache for port 329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:33:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updated VIF entry in instance network info cache for port 329285b3-6416-41f9-92d6-aef1de3c371c. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:33:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updating instance_info_cache with network_info: [{"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-00feb0d7-b654-401e-9617-e5a9cf9491c0 req-71e254c5-8319-4c89-ac34-b2e482b24f72 service nova] Releasing lock "refresh_cache-81ee370f-84d3-476b-a6c3-5bd7bc334548" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:33:41 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056806.8717327, 77eb9676-06b7-4a3e-b6cc-58cec7b907dc => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:33:41 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] VM Stopped (Lifecycle Event)
Aug 26 13:33:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8711b375-5acc-4340-a06c-e2ec36511739 None None] [instance: 77eb9676-06b7-4a3e-b6cc-58cec7b907dc] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing instance network info cache due to event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:33:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:43 user nova-compute[73503]: INFO nova.compute.manager [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Terminating instance
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.compute.manager [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-5fc7c74a-6a2f-4d80-8637-fd51a204fb59 req-0c324b51-d8f1-4f7f-9a04-fd6ec949c037 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-vif-unplugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5fc7c74a-6a2f-4d80-8637-fd51a204fb59 req-0c324b51-d8f1-4f7f-9a04-fd6ec949c037 service nova] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5fc7c74a-6a2f-4d80-8637-fd51a204fb59 req-0c324b51-d8f1-4f7f-9a04-fd6ec949c037 service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5fc7c74a-6a2f-4d80-8637-fd51a204fb59 req-0c324b51-d8f1-4f7f-9a04-fd6ec949c037 service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-5fc7c74a-6a2f-4d80-8637-fd51a204fb59 req-0c324b51-d8f1-4f7f-9a04-fd6ec949c037 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] No waiting events found dispatching network-vif-unplugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-5fc7c74a-6a2f-4d80-8637-fd51a204fb59 req-0c324b51-d8f1-4f7f-9a04-fd6ec949c037 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-vif-unplugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updated VIF entry in instance network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-354ff152-7910-473b-aa96-9e14794419f1 req-38822643-1daa-42d0-a625-fbf979a8b06e service nova] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:33:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Instance destroyed successfully.
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.objects.instance [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lazy-loading 'resources' on Instance uuid edabb5ef-a0a9-44b5-b49e-7c4c24fb259b {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1377592966',display_name='tempest-VolumesNegativeTest-instance-1377592966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1377592966',id=41,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ac996d683ab4df38b492abdd8f9311f',ramdisk_id='',reservation_id='r-yjwatkcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1756260103',owner_user_name='tempest-VolumesNegativeTest-1756260103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:32:03Z,user_data=None,user_id='a769a9e32954483eb1ad16a225d3676a',uuid=edabb5ef-a0a9-44b5-b49e-7c4c24fb259b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Converting VIF {"id": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "address": "fa:16:3e:cc:1f:5d", "network": {"id": "375c2f18-745d-4e02-91e9-36301a6f7a66", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "6e791872642e435180feefd03ef1d9af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3368fdc-ee", "ovs_interfaceid": "b3368fdc-ee03-4b93-9a40-ea68bf5703ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG os_vif [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3368fdc-ee, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:33:43 user nova-compute[73503]: INFO os_vif [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1f:5d,bridge_name='br-int',has_traffic_filtering=True,id=b3368fdc-ee03-4b93-9a40-ea68bf5703ff,network=Network(375c2f18-745d-4e02-91e9-36301a6f7a66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3368fdc-ee')
Aug 26 13:33:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Deleting instance files /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b_del
Aug 26 13:33:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Deletion of /opt/stack/data/nova/instances/edabb5ef-a0a9-44b5-b49e-7c4c24fb259b_del complete
Aug 26 13:33:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:33:44 user nova-compute[73503]: INFO nova.compute.manager [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:33:44 user nova-compute[73503]: INFO nova.compute.manager [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] instance snapshotting
Aug 26 13:33:44 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Beginning live snapshot process
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json -f qcow2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:44 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Took 0.77 seconds to deallocate network for instance.
Aug 26 13:33:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-1478701c-19d9-43f1-9298-282de332c29f req-345e25e4-7702-42a9-9b06-5dfa67f10829 service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-vif-deleted-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json -f qcow2" returned: 0 in 0.278s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdqtxg_fd/558f5a058b9f4073ba72ebdb96cd04c2.delta 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdqtxg_fd/558f5a058b9f4073ba72ebdb96cd04c2.delta 1073741824" returned: 0 in 0.050s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:45 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:45 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Deleted allocations for instance edabb5ef-a0a9-44b5-b49e-7c4c24fb259b
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-928f99d3-08c4-4cda-975f-234856fbb51f tempest-VolumesNegativeTest-1756260103 tempest-VolumesNegativeTest-1756260103-project-member] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-35a748ed-4a32-451d-a91e-556da085b9e4 req-91dfe61c-107b-472b-a86d-a4145f0dcc9e service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received event network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-35a748ed-4a32-451d-a91e-556da085b9e4 req-91dfe61c-107b-472b-a86d-a4145f0dcc9e service nova] Acquiring lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-35a748ed-4a32-451d-a91e-556da085b9e4 req-91dfe61c-107b-472b-a86d-a4145f0dcc9e service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-35a748ed-4a32-451d-a91e-556da085b9e4 req-91dfe61c-107b-472b-a86d-a4145f0dcc9e service nova] Lock "edabb5ef-a0a9-44b5-b49e-7c4c24fb259b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.compute.manager [req-35a748ed-4a32-451d-a91e-556da085b9e4 req-91dfe61c-107b-472b-a86d-a4145f0dcc9e service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] No waiting events found dispatching network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:45 user nova-compute[73503]: WARNING nova.compute.manager [req-35a748ed-4a32-451d-a91e-556da085b9e4 req-91dfe61c-107b-472b-a86d-a4145f0dcc9e service nova] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Received unexpected event network-vif-plugged-b3368fdc-ee03-4b93-9a40-ea68bf5703ff for instance with vm_state deleted and task_state None.
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.objects.instance [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:45 user nova-compute[73503]: INFO nova.compute.manager [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attaching volume 110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 to /dev/vdb
Aug 26 13:33:45 user nova-compute[73503]: DEBUG os_brick.utils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d771127-2a86-4f75-a97f-f315771697a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[668ce82a-f9ce-4139-b0fb-329dbd242c59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd07a7-e9b5-40a2-8f29-332b6ef61bff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a80f84-773d-43df-8496-8fc713b51a9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:33:45 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:33:45 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa02a8-73ea-499a-bf55-62b760895614]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG os_brick.utils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:33:45 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updating existing volume attachment record: d93432ac-7a99-4829-90cb-1d66a4b0bead {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:33:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73503) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 13:33:46 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 13:33:46 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:33:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdqtxg_fd/558f5a058b9f4073ba72ebdb96cd04c2.delta /opt/stack/data/nova/instances/snapshots/tmpdqtxg_fd/558f5a058b9f4073ba72ebdb96cd04c2 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdqtxg_fd/558f5a058b9f4073ba72ebdb96cd04c2.delta /opt/stack/data/nova/instances/snapshots/tmpdqtxg_fd/558f5a058b9f4073ba72ebdb96cd04c2" returned: 0 in 0.365s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:46 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Snapshot extracted, beginning image upload
Aug 26 13:33:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:48 user nova-compute[73503]: INFO nova.compute.manager [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Detaching volume 0433f466-10b5-407e-b1b8-9c0ef081a58f
Aug 26 13:33:48 user nova-compute[73503]: INFO nova.virt.block_device [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Attempting to driver detach volume 0433f466-10b5-407e-b1b8-9c0ef081a58f from mountpoint /dev/vdb
Aug 26 13:33:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Attempting to detach device vdb from instance 5d626cfa-cc85-452f-b0a5-a78866419404 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:33:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:33:48 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:33:48 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:33:48 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:33:48 user nova-compute[73503]:   <serial>0433f466-10b5-407e-b1b8-9c0ef081a58f</serial>
Aug 26 13:33:48 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:33:48 user nova-compute[73503]: </disk>
Aug 26 13:33:48 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:33:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully detached device vdb from instance 5d626cfa-cc85-452f-b0a5-a78866419404 from the persistent domain config.
Aug 26 13:33:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d626cfa-cc85-452f-b0a5-a78866419404 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:33:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:33:48 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:33:48 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:33:48 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:33:48 user nova-compute[73503]:   <serial>0433f466-10b5-407e-b1b8-9c0ef081a58f</serial>
Aug 26 13:33:48 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:33:48 user nova-compute[73503]: </disk>
Aug 26 13:33:48 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:33:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Snapshot image upload complete
Aug 26 13:33:49 user nova-compute[73503]: INFO nova.compute.manager [None req-7ff78e84-3ec0-477c-b733-fe8cc0519e21 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Took 5.12 seconds to snapshot the instance on the hypervisor.
Aug 26 13:33:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056829.3801267, 5d626cfa-cc85-452f-b0a5-a78866419404 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d626cfa-cc85-452f-b0a5-a78866419404 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:33:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully detached device vdb from instance 5d626cfa-cc85-452f-b0a5-a78866419404 from the live domain config.
Aug 26 13:33:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBSoZjUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:33:49 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9308ccb3-18ae-4c8a-ad11-190ce58b14dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb22a2-b1ec-47b8-8213-88c404131aaa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:49 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:49 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:33:49 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:49 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:49 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:49 user nova-compute[73503]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f (non-flash)
Aug 26 13:33:49 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:49 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3044028c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[355bb132-d78f-4ad1-875a-c02e5bac6769]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[607a07c8-136e-423d-91e2-98856d7629b9]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95a12b7-6f73-4d97-b3a2-369887df7634]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4904f-081e-45f9-8b21-390ec5fc9bf6]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e819b80-b814-4440-ac72-edeba16eafb1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd805201-da3a-412d-a9f1-0eefb1095472]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260]
Aug 26 13:33:49 user nova-compute[73503]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f, portal: 172.16.0.220,3260] successful.
Aug 26 13:33:49 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[59edb352-eb99-4f12-a3f8-066b0d17446f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== disconnect_volume: return (275ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:33:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'flavor' on Instance uuid 5d626cfa-cc85-452f-b0a5-a78866419404 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2b33a8a9-a14a-4115-b5de-f16e0fc59eba tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.587s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:50 user nova-compute[73503]: INFO nova.compute.manager [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Terminating instance
Aug 26 13:33:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-031125e4-386b-45d8-9205-36f752267811 req-bc196edf-f57f-46bb-905a-3034291b2668 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-vif-unplugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-031125e4-386b-45d8-9205-36f752267811 req-bc196edf-f57f-46bb-905a-3034291b2668 service nova] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-031125e4-386b-45d8-9205-36f752267811 req-bc196edf-f57f-46bb-905a-3034291b2668 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-031125e4-386b-45d8-9205-36f752267811 req-bc196edf-f57f-46bb-905a-3034291b2668 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-031125e4-386b-45d8-9205-36f752267811 req-bc196edf-f57f-46bb-905a-3034291b2668 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] No waiting events found dispatching network-vif-unplugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-031125e4-386b-45d8-9205-36f752267811 req-bc196edf-f57f-46bb-905a-3034291b2668 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-vif-unplugged-7fbcd820-0de2-4247-bab7-a129479abf98 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:33:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Instance destroyed successfully.
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'resources' on Instance uuid 5d626cfa-cc85-452f-b0a5-a78866419404 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-319884411',display_name='tempest-VolumesSnapshotTestJSON-instance-319884411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-319884411',id=37,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5ap2wFN9Hic/xzDfE99I9pUHZtc8Y42F6JsTflBvuZPbO2z4KcuFC1FAK51/dmdBF/YI45swABv8cR15xN8+FZf2gPZMP5Wcv++JLF3BAUUCyQ0sex40peSb7rtP4hgg==',key_name='tempest-keypair-975803582',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576be623b4ce46609c0ffee21379fd9d',ramdisk_id='',reservation_id='r-398rjafq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1292919532',owner_user_name='tempest-VolumesSnapshotTestJSON-1292919532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:31:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb38c05c97845f2b48b81aa5202945b',uuid=5d626cfa-cc85-452f-b0a5-a78866419404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converting VIF {"id": "7fbcd820-0de2-4247-bab7-a129479abf98", "address": "fa:16:3e:87:4e:42", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbcd820-0d", "ovs_interfaceid": "7fbcd820-0de2-4247-bab7-a129479abf98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_vif [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fbcd820-0d, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:51 user nova-compute[73503]: INFO os_vif [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:4e:42,bridge_name='br-int',has_traffic_filtering=True,id=7fbcd820-0de2-4247-bab7-a129479abf98,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbcd820-0d')
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QBSoZjUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:33:51 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0433f466-10b5-407e-b1b8-9c0ef081a58f', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc22a0a6-a3d6-4a5b-a0e2-e7fadfdbadb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e82ae8-54d5-460f-8fa1-04041dff9831]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:51 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:51 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:51 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:51 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30463e3b0>, {}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Disconnecting from: [] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== disconnect_volume: return (49ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:33:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Deleting instance files /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404_del
Aug 26 13:33:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Deletion of /opt/stack/data/nova/instances/5d626cfa-cc85-452f-b0a5-a78866419404_del complete
Aug 26 13:33:51 user nova-compute[73503]: INFO nova.compute.manager [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 13:33:51 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:33:51 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:33:52 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Took 0.86 seconds to deallocate network for instance.
Aug 26 13:33:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-648b6351-f686-4230-b27b-b7850da90abd req-a763bd59-deba-4e26-a794-144464ad0d0e service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-vif-deleted-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:52 user nova-compute[73503]: WARNING nova.volume.cinder [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Attachment 4ae9a574-1a01-47c6-a7e9-8d3df47c6709 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4ae9a574-1a01-47c6-a7e9-8d3df47c6709. (HTTP 404) (Request-ID: req-221e7563-25b8-476e-a86e-75ac3c8b461b)
Aug 26 13:33:52 user nova-compute[73503]: INFO nova.compute.manager [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:52 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Deleted allocations for instance 5d626cfa-cc85-452f-b0a5-a78866419404
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1919a7cc-f47a-4eeb-8d26-e5ce7fe049d3 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "5d626cfa-cc85-452f-b0a5-a78866419404" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-fee9e1c9-858f-4ec1-89a4-9714d03f4e3b req-eb59e8f7-0094-450f-8af7-93126b1fcb00 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received event network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fee9e1c9-858f-4ec1-89a4-9714d03f4e3b req-eb59e8f7-0094-450f-8af7-93126b1fcb00 service nova] Acquiring lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fee9e1c9-858f-4ec1-89a4-9714d03f4e3b req-eb59e8f7-0094-450f-8af7-93126b1fcb00 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fee9e1c9-858f-4ec1-89a4-9714d03f4e3b req-eb59e8f7-0094-450f-8af7-93126b1fcb00 service nova] Lock "5d626cfa-cc85-452f-b0a5-a78866419404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:33:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-fee9e1c9-858f-4ec1-89a4-9714d03f4e3b req-eb59e8f7-0094-450f-8af7-93126b1fcb00 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] No waiting events found dispatching network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:33:52 user nova-compute[73503]: WARNING nova.compute.manager [req-fee9e1c9-858f-4ec1-89a4-9714d03f4e3b req-eb59e8f7-0094-450f-8af7-93126b1fcb00 service nova] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Received unexpected event network-vif-plugged-7fbcd820-0de2-4247-bab7-a129479abf98 for instance with vm_state deleted and task_state None.
Aug 26 13:33:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnXSurWx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:33:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:33:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:33:57 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c462e86-1c95-4694-be08-a435c4484570]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:33:57 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[db686de5-3b6c-44bd-91c8-b7b4677d3c08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8] added
Aug 26 13:33:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb30c6b-6b33-42a8-91ea-d1b6762d6177]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a1d8fc-4bfe-4d56-912e-c8742debf115]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnXSurWx {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnXSurWx" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0f265-a840-4a03-b228-0c42dc0e4aed]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnXSurWx'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[928aa16a-45aa-40af-9a59-4d013ef80c9d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[054b5c42-d97f-40e4-b40f-220aaf6c78b4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa33f4d-3977-4012-8692-dbabedbf0a0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260]
Aug 26 13:33:57 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260] successful.
Aug 26 13:33:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aeffc8-6320-4b67-9a4e-ea794488fdb9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[436be41e-543d-4e05-9346-76eb3e28b155]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:33:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[953d0f4f-5e63-4d3a-b445-76ac0e4c201c]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:33:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnXSurWx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23830633566383161', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830633566383161', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG nova.objects.instance [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:33:58 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:33:58 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:33:58 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:33:58 user nova-compute[73503]:   <serial>110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8</serial>
Aug 26 13:33:58 user nova-compute[73503]: </disk>
Aug 26 13:33:58 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:33:58 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056823.9081051, edabb5ef-a0a9-44b5-b49e-7c4c24fb259b => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:33:58 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] VM Stopped (Lifecycle Event)
Aug 26 13:33:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-86acf0d0-4fb0-41b9-b543-002b7e3dc260 None None] [instance: edabb5ef-a0a9-44b5-b49e-7c4c24fb259b] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:33:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:33:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:33:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No VIF found with MAC fa:16:3e:60:5d:6d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:33:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-110c31f7-4360-4e1b-a306-48eba7a6e0e2 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.486s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:03 user nova-compute[73503]: INFO nova.compute.manager [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attaching volume fd63aca0-88a2-4759-8358-a4e0339b6b22 to /dev/vdc
Aug 26 13:34:03 user nova-compute[73503]: DEBUG os_brick.utils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3677081-e1d1-40d5-aa95-84d8ae34dba3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[700ede88-3b66-4832-80b3-aecbd7ebc432]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1bc090-e989-4f72-afd4-a283c5f81637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe41e315-2acf-4bee-a5d8-c8dd2b37f347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:34:03 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:34:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6fbf6d-64cf-46a3-86bc-f58ebc4009e0]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG os_brick.utils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:03 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updating existing volume attachment record: d9600fb6-968e-479e-817a-c2df6979199c {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:34:06 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056831.281569, 5d626cfa-cc85-452f-b0a5-a78866419404 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:34:06 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] VM Stopped (Lifecycle Event)
Aug 26 13:34:06 user nova-compute[73503]: DEBUG nova.compute.manager [None req-02072ae5-08c8-41ae-9a85-07acc594fea8 None None] [instance: 5d626cfa-cc85-452f-b0a5-a78866419404] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:34:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKvNpjMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:14 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:14 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:14 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[98713aac-0902-4dc1-8d15-a385a0769d97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:34:14 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df548b-35f1-46e7-a87d-c0dda1c8ddf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22] added
Aug 26 13:34:14 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e55bc-5238-4f2d-ab08-cc1b06b9f45b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2a453f-a630-41ef-b61c-f61491696d10]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKvNpjMZ {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DKvNpjMZ" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320848e-bee1-46da-b6f6-5685247d4df0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DKvNpjMZ'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d939e0f9-5aee-4bff-89bf-e46ff7981372]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[219276dd-eae1-4f96-b5c6-59627ee963aa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b9b81-659d-4f8b-8cfe-d981e227e4f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260]
Aug 26 13:34:15 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260] successful.
Aug 26 13:34:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7298295-ac02-40d5-8ab7-c16b1c0bc753]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfff83e-ce83-4943-bd40-952204678e52]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)
Aug 26 13:34:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3a6de-4d70-4608-a252-d952e48e5f38]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:34:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKvNpjMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23761393234323439', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761393234323439', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:34:16 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:16 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:34:16 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:34:16 user nova-compute[73503]:   <serial>fd63aca0-88a2-4759-8358-a4e0339b6b22</serial>
Aug 26 13:34:16 user nova-compute[73503]: </disk>
Aug 26 13:34:16 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] No VIF found with MAC fa:16:3e:60:5d:6d, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:34:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8e8e53d2-7f4b-4ca3-a568-0c301911d88a tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.140s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:17 user nova-compute[73503]: INFO nova.compute.manager [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Detaching volume 110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8
Aug 26 13:34:17 user nova-compute[73503]: INFO nova.virt.block_device [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attempting to driver detach volume 110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 from mountpoint /dev/vdb
Aug 26 13:34:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Attempting to detach device vdb from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:34:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:34:17 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:17 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:34:17 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:34:17 user nova-compute[73503]:   <serial>110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8</serial>
Aug 26 13:34:17 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:34:17 user nova-compute[73503]: </disk>
Aug 26 13:34:17 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:34:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully detached device vdb from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the persistent domain config.
Aug 26 13:34:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:34:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:34:17 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:17 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:34:17 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:34:17 user nova-compute[73503]:   <serial>110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8</serial>
Aug 26 13:34:17 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:34:17 user nova-compute[73503]: </disk>
Aug 26 13:34:17 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.compute.manager [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-changed-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.compute.manager [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Refreshing instance network info cache due to event network-changed-42d01d63-729f-4a4a-aa65-c20715619d37. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] Acquiring lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] Acquired lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.network.neutron [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Refreshing network info cache for port 42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056858.3858228, 81ee370f-84d3-476b-a6c3-5bd7bc334548 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:34:18 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully detached device vdb from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the live domain config.
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnXSurWx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:18 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b451233-7d00-4cad-9f1d-514058b894de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9938c1f7-0f24-48c6-875a-484edaf00d07]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)
Aug 26 13:34:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3145b7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6476864a-66a9-4fce-a311-ab7e043694f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ad6c2f-a99b-4021-a220-69788f2e8e49]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.network.neutron [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updated VIF entry in instance network info cache for port 42d01d63-729f-4a4a-aa65-c20715619d37. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.network.neutron [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updating instance_info_cache with network_info: [{"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8aa5f1-0ec7-46d9-8d49-97dc0e3fd7cb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9076bc31-7850-4eb3-a220-47326fb42668 req-800efed2-c86b-4fbd-888f-96e5497d4e7d service nova] Releasing lock "refresh_cache-0f52dfe3-0414-40eb-8958-8c73dab19ff2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb20afb-d39a-4eca-a098-9a5d730083f4]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[101ced28-5bac-4c22-82a4-110ab9810d5b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fea16c-8f27-43ff-8826-893048243626]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260]
Aug 26 13:34:18 user nova-compute[73503]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8, portal: 172.16.0.220,3260] successful.
Aug 26 13:34:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:110fffc5-f22c-4cf9-9b6b-0bb7ea713eb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27167769-2039-43d4-9453-02a5ca64df53]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== disconnect_volume: return (326ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:34:19 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b162ef10-836d-4ac3-86ee-f55156a1b515 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.752s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:20 user nova-compute[73503]: INFO nova.compute.manager [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Detaching volume fd63aca0-88a2-4759-8358-a4e0339b6b22
Aug 26 13:34:20 user nova-compute[73503]: INFO nova.virt.block_device [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Attempting to driver detach volume fd63aca0-88a2-4759-8358-a4e0339b6b22 from mountpoint /dev/vdc
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Attempting to detach device vdc from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:34:20 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:20 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:34:20 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:34:20 user nova-compute[73503]:   <serial>fd63aca0-88a2-4759-8358-a4e0339b6b22</serial>
Aug 26 13:34:20 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 13:34:20 user nova-compute[73503]: </disk>
Aug 26 13:34:20 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:34:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully detached device vdc from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the persistent domain config.
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:34:20 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:20 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:34:20 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:34:20 user nova-compute[73503]:   <serial>fd63aca0-88a2-4759-8358-a4e0339b6b22</serial>
Aug 26 13:34:20 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 13:34:20 user nova-compute[73503]: </disk>
Aug 26 13:34:20 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056860.8551154, 81ee370f-84d3-476b-a6c3-5bd7bc334548 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:34:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully detached device vdc from instance 81ee370f-84d3-476b-a6c3-5bd7bc334548 from the live domain config.
Aug 26 13:34:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DKvNpjMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:20 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a43060-b514-4efb-ae6e-35e05c3099b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66c316-3314-48a4-aef4-c8b7dc134362]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:20 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:20 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:20 user nova-compute[73503]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)
Aug 26 13:34:20 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:20 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:20 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:20 user nova-compute[73503]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 (non-flash)
Aug 26 13:34:20 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304383760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29178d4-a433-4c8f-b52b-7ad117b5ba6f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6cd76-14c5-4b9b-bf10-267d1211064b]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7cc85-9a03-434c-b564-49d557986c21]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:34:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a693e-9627-4cc9-bbd5-b5bfc94d87f8]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809af83-ac3a-49d0-bb9b-9e3e5f444857]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3995faf-f075-4423-b62c-8d2872c15645]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260]
Aug 26 13:34:21 user nova-compute[73503]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22, portal: 172.16.0.220,3260] successful.
Aug 26 13:34:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd63aca0-88a2-4759-8358-a4e0339b6b22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[713e85fa-7bab-4a6a-b72c-24afd7833e03]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] <== disconnect_volume: return (282ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:34:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'flavor' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0fb7e3a9-98e8-442d-bce5-949bb019af42 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 0f52dfe3-0414-40eb-8958-8c73dab19ff2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:22 user nova-compute[73503]: INFO nova.compute.manager [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Terminating instance
Aug 26 13:34:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:34:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:23 user nova-compute[73503]: INFO nova.compute.manager [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Attaching volume da99e112-6cad-4155-a35e-d126896dd730 to /dev/vdb
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_brick.utils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3690be91-85d7-4b60-b643-ebcc690ae12f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08310ae4-22e9-45f3-bd21-b627a99fa865]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae91a5e-215d-4d43-9f54-732f322a80be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d1722-0daa-4304-8127-f391b7b63f37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:34:23 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74003dc-3802-4801-9bf1-012540aece91]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_brick.utils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updating existing volume attachment record: 78a57c4f-fd91-4e9c-b5a3-69fb9cf29079 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-9ad5823e-c6bf-4780-87dc-afd2eff5d415 req-3d081e13-6507-4a46-998c-2e0d72330666 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-vif-unplugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9ad5823e-c6bf-4780-87dc-afd2eff5d415 req-3d081e13-6507-4a46-998c-2e0d72330666 service nova] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9ad5823e-c6bf-4780-87dc-afd2eff5d415 req-3d081e13-6507-4a46-998c-2e0d72330666 service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9ad5823e-c6bf-4780-87dc-afd2eff5d415 req-3d081e13-6507-4a46-998c-2e0d72330666 service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-9ad5823e-c6bf-4780-87dc-afd2eff5d415 req-3d081e13-6507-4a46-998c-2e0d72330666 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] No waiting events found dispatching network-vif-unplugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-9ad5823e-c6bf-4780-87dc-afd2eff5d415 req-3d081e13-6507-4a46-998c-2e0d72330666 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-vif-unplugged-329285b3-6416-41f9-92d6-aef1de3c371c for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:34:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Instance destroyed successfully.
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lazy-loading 'resources' on Instance uuid 81ee370f-84d3-476b-a6c3-5bd7bc334548 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1888828770',display_name='tempest-AttachVolumeTestJSON-server-1888828770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1888828770',id=39,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPCA84IEXGGV0fDL2IbX7qYH3C92ExEMAkz6sQaV/ROYI9kE7B5bDJtR3f2kyPvoI/3B5Q81nXxtSdioSK6WwZ8B50jU2MVeL6Jo7gQ84zRnTlhlk98+/kLktheh7v75A==',key_name='tempest-keypair-1823131430',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c8314eb6dec444ea31e9685d11b2fac',ramdisk_id='',reservation_id='r-nyf0ayx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1183738962',owner_user_name='tempest-AttachVolumeTestJSON-1183738962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:31:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6390e5b4c64754ab6f14217f4da833',uuid=81ee370f-84d3-476b-a6c3-5bd7bc334548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converting VIF {"id": "329285b3-6416-41f9-92d6-aef1de3c371c", "address": "fa:16:3e:60:5d:6d", "network": {"id": "c93ce3a7-ca79-4e61-94fc-b82ace09211b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1879716185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c8314eb6dec444ea31e9685d11b2fac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap329285b3-64", "ovs_interfaceid": "329285b3-6416-41f9-92d6-aef1de3c371c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG os_vif [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap329285b3-64, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:34:23 user nova-compute[73503]: INFO os_vif [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:5d:6d,bridge_name='br-int',has_traffic_filtering=True,id=329285b3-6416-41f9-92d6-aef1de3c371c,network=Network(c93ce3a7-ca79-4e61-94fc-b82ace09211b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap329285b3-64')
Aug 26 13:34:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Deleting instance files /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548_del
Aug 26 13:34:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Deletion of /opt/stack/data/nova/instances/81ee370f-84d3-476b-a6c3-5bd7bc334548_del complete
Aug 26 13:34:23 user nova-compute[73503]: INFO nova.compute.manager [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 13:34:23 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:34:23 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:34:24 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:34:24 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Took 0.77 seconds to deallocate network for instance.
Aug 26 13:34:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:24 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:34:24 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:34:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:24 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Deleted allocations for instance 81ee370f-84d3-476b-a6c3-5bd7bc334548
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1fdb360f-7588-4bc3-9d66-e92800f0f8e7 tempest-AttachVolumeTestJSON-1183738962 tempest-AttachVolumeTestJSON-1183738962-project-member] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] Acquiring lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] Lock "81ee370f-84d3-476b-a6c3-5bd7bc334548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] No waiting events found dispatching network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:34:25 user nova-compute[73503]: WARNING nova.compute.manager [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received unexpected event network-vif-plugged-329285b3-6416-41f9-92d6-aef1de3c371c for instance with vm_state deleted and task_state None.
Aug 26 13:34:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-8eec6d35-1555-4722-9ac4-f904d0de8efa req-5ae9bf1d-4e7d-4152-a1fe-351b1856bc72 service nova] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Received event network-vif-deleted-329285b3-6416-41f9-92d6-aef1de3c371c {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:34:25 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:34:26 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updating instance_info_cache with network_info: [{"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:34:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-d0fab249-2251-46e5-8b6e-83df64db1cf2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:34:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:34:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:34:30 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:34:30 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=7809MB free_disk=24.840442657470703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d0fab249-2251-46e5-8b6e-83df64db1cf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance a851a51f-69aa-4580-bc92-f23485b352eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:34:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:34:31 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:34:31 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:34:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:34:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cprbolSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:35 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:35 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:35 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddd1694-6ed7-418e-b6ad-5ad51b3d5c1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:34:35 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b0e24-038f-4af8-8535-69306237f797]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730] added
Aug 26 13:34:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d06a20f-17c0-474e-881a-0cdbc106b9b9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a432fa-63ce-4ee2-ae9b-9172d7cf8d8f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cprbolSg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cprbolSg" returned: 0 in 0.035s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74d5cda-4fdc-47f4-a0cd-31892945aa61]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cprbolSg'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e52bb9a-0f35-4b4d-8ba6-eaae772c8e1b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a5c8c-c271-4cf5-a020-34ec3a82440e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5059c8-aac6-4560-8968-f43a4f2c1c3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260]
Aug 26 13:34:35 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260] successful.
Aug 26 13:34:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cfaf48-1fa4-40df-b7b0-84ff37ca8c85]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13f653-5ef3-4269-9f0e-b1233707f9fc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 (non-flash)
Aug 26 13:34:35 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170f7d3-8422-4c77-afd5-27f2f59a4849]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:34:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cprbolSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:34:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23164363137323435', 'path': '/dev/sde'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164363137323435', 'path': '/dev/sde'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:34:36 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 0f52dfe3-0414-40eb-8958-8c73dab19ff2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:34:36 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:36 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:34:36 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:34:36 user nova-compute[73503]:   <serial>da99e112-6cad-4155-a35e-d126896dd730</serial>
Aug 26 13:34:36 user nova-compute[73503]: </disk>
Aug 26 13:34:36 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:34:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:34:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:34:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] No VIF found with MAC fa:16:3e:b1:cd:e5, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:34:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a79cd00f-f65a-42a1-b13f-27c04844d0b4 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.311s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:38 user nova-compute[73503]: INFO nova.compute.manager [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Detaching volume da99e112-6cad-4155-a35e-d126896dd730
Aug 26 13:34:38 user nova-compute[73503]: INFO nova.virt.block_device [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Attempting to driver detach volume da99e112-6cad-4155-a35e-d126896dd730 from mountpoint /dev/vdb
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Attempting to detach device vdb from instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:34:38 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:38 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:34:38 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:34:38 user nova-compute[73503]:   <serial>da99e112-6cad-4155-a35e-d126896dd730</serial>
Aug 26 13:34:38 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:34:38 user nova-compute[73503]: </disk>
Aug 26 13:34:38 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:34:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully detached device vdb from instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 from the persistent domain config.
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:34:38 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:34:38 user nova-compute[73503]:   <source dev="/dev/sde"/>
Aug 26 13:34:38 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:34:38 user nova-compute[73503]:   <serial>da99e112-6cad-4155-a35e-d126896dd730</serial>
Aug 26 13:34:38 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:34:38 user nova-compute[73503]: </disk>
Aug 26 13:34:38 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056863.6703367, 81ee370f-84d3-476b-a6c3-5bd7bc334548 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:34:38 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] VM Stopped (Lifecycle Event)
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-92dd4c08-6420-4246-a844-50701b42b69a None None] [instance: 81ee370f-84d3-476b-a6c3-5bd7bc334548] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:38 user nova-compute[73503]: INFO nova.compute.manager [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Terminating instance
Aug 26 13:34:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693056879.0185266, 0f52dfe3-0414-40eb-8958-8c73dab19ff2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:34:39 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully detached device vdb from instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2 from the live domain config.
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cprbolSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:39 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9daad6d-859a-4c06-95e0-2b9697cb5abf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a87ce2-713b-4787-a070-86268cda1d36]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3044224d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730'): ({'sde'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Removing single pathed devices sde {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[58965865-8c06-48d4-8b99-f41a8f4b36b6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a2f3cf-87ac-4b77-9161-697b2ea90e1f]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Flushing IO for device /dev/sde {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[179441a2-2ae7-4fc8-b645-887ac7bc94d8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83e824-12b3-41c0-9401-c1065106bbd9]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] SCSI volumes sde have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f0c18cc-069e-4fd8-a73b-87e7705f0a99 req-c8b1cd4f-148f-477f-a9ed-f349786847c6 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f0c18cc-069e-4fd8-a73b-87e7705f0a99 req-c8b1cd4f-148f-477f-a9ed-f349786847c6 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f0c18cc-069e-4fd8-a73b-87e7705f0a99 req-c8b1cd4f-148f-477f-a9ed-f349786847c6 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8f0c18cc-069e-4fd8-a73b-87e7705f0a99 req-c8b1cd4f-148f-477f-a9ed-f349786847c6 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f0c18cc-069e-4fd8-a73b-87e7705f0a99 req-c8b1cd4f-148f-477f-a9ed-f349786847c6 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-8f0c18cc-069e-4fd8-a73b-87e7705f0a99 req-c8b1cd4f-148f-477f-a9ed-f349786847c6 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-unplugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[65805fe7-e4ab-45c4-b1fb-615f8fbd8e71]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2133a79c-f9e1-483b-9912-5d77f6148385]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260]
Aug 26 13:34:39 user nova-compute[73503]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730, portal: 172.16.0.220,3260] successful.
Aug 26 13:34:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da99e112-6cad-4155-a35e-d126896dd730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf8947e-9422-480e-9304-b64d2e638a35]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] <== disconnect_volume: return (402ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Instance destroyed successfully.
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.objects.instance [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'resources' on Instance uuid 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-978110447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-978110447',id=35,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:31:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-yvxrix42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:32:53Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=1f167a1d-4fc5-4938-bb6e-e0fbb90b542a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "address": "fa:16:3e:4b:0b:87", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1397c3a8-2a", "ovs_interfaceid": "1397c3a8-2a80-4ffe-a02c-5a0f1613d066", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_vif [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1397c3a8-2a, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:34:39 user nova-compute[73503]: INFO os_vif [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0b:87,bridge_name='br-int',has_traffic_filtering=True,id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1397c3a8-2a')
Aug 26 13:34:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBYJFfrl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:34:39 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe1e7d1-5778-4720-b6bd-63e7c2f2ca3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[723ba92e-a382-42fc-b79a-1dd63a1315c7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8bf431c-806b-43aa-aab2-1031fa18cc86 (non-flash)
Aug 26 13:34:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30435f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3'): ({'sdf'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Removing single pathed devices sdf {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf55f49-3d91-410a-90d9-4a1d0d8ab653]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[445b29e3-ae5c-49f3-9906-277f80e24142]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flushing IO for device /dev/sdf {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cd46bd-774c-4934-967c-c8f588498753]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:34:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.103s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6395570c-786f-46e2-bdaf-2152234f1c2c]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] SCSI volumes sdf have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6149e2', '/dev/disk/by-id/scsi-1SCST_BIOf6149e2-448a46a721c590de', '/dev/disk/by-id/scsi-23434386134366137') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b3d7ee-eb3d-4677-af09-2ac95295cb2b]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4b0f6-8b4e-4ce9-8cf4-cedc10c4e6a3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdb027e-3a5e-4393-bb5b-0de50286ca87]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260]
Aug 26 13:34:40 user nova-compute[73503]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3, portal: 172.16.0.220,3260] successful.
Aug 26 13:34:40 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7ff8be1-4f0c-452e-a991-65eaeca097b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849aff8-0940-4283-99bd-fddf66a18369]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== disconnect_volume: return (424ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:34:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Deleting instance files /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a_del
Aug 26 13:34:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Deletion of /opt/stack/data/nova/instances/1f167a1d-4fc5-4938-bb6e-e0fbb90b542a_del complete
Aug 26 13:34:40 user nova-compute[73503]: INFO nova.compute.manager [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'flavor' on Instance uuid 0f52dfe3-0414-40eb-8958-8c73dab19ff2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:34:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-b52544e5-908c-4d1f-a009-63750476a86d tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.393s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-bb90c449-9170-4b9f-ad0a-0f6e692dfa46 req-f6a590ec-5199-4287-96ff-637473bcb659 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bb90c449-9170-4b9f-ad0a-0f6e692dfa46 req-f6a590ec-5199-4287-96ff-637473bcb659 service nova] Acquiring lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bb90c449-9170-4b9f-ad0a-0f6e692dfa46 req-f6a590ec-5199-4287-96ff-637473bcb659 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bb90c449-9170-4b9f-ad0a-0f6e692dfa46 req-f6a590ec-5199-4287-96ff-637473bcb659 service nova] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-bb90c449-9170-4b9f-ad0a-0f6e692dfa46 req-f6a590ec-5199-4287-96ff-637473bcb659 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] No waiting events found dispatching network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:34:41 user nova-compute[73503]: WARNING nova.compute.manager [req-bb90c449-9170-4b9f-ad0a-0f6e692dfa46 req-f6a590ec-5199-4287-96ff-637473bcb659 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received unexpected event network-vif-plugged-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 for instance with vm_state active and task_state deleting.
Aug 26 13:34:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-b05b980c-0f33-46bf-aa24-d83e24ac031f req-3c8a6a58-992d-4c88-958a-f96bdb374481 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Received event network-vif-deleted-1397c3a8-2a80-4ffe-a02c-5a0f1613d066 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:34:43 user nova-compute[73503]: INFO nova.compute.manager [req-b05b980c-0f33-46bf-aa24-d83e24ac031f req-3c8a6a58-992d-4c88-958a-f96bdb374481 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Neutron deleted interface 1397c3a8-2a80-4ffe-a02c-5a0f1613d066; detaching it from the instance and deleting it from the info cache
Aug 26 13:34:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-b05b980c-0f33-46bf-aa24-d83e24ac031f req-3c8a6a58-992d-4c88-958a-f96bdb374481 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:34:43 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:34:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-b05b980c-0f33-46bf-aa24-d83e24ac031f req-3c8a6a58-992d-4c88-958a-f96bdb374481 service nova] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Detach interface failed, port_id=1397c3a8-2a80-4ffe-a02c-5a0f1613d066, reason: Instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:34:43 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Took 3.13 seconds to deallocate network for instance.
Aug 26 13:34:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:44 user nova-compute[73503]: INFO nova.compute.manager [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Took 1.49 seconds to detach 1 volumes for instance.
Aug 26 13:34:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:34:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:34:45 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:34:45 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:34:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:45 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Deleted allocations for instance 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a
Aug 26 13:34:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-130037b8-41d7-45fa-8a05-f3a7108984d8 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "1f167a1d-4fc5-4938-bb6e-e0fbb90b542a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.110s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:34:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:34:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:54 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056879.7217548, 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:34:54 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] VM Stopped (Lifecycle Event)
Aug 26 13:34:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-79654692-b40a-490f-86e3-16aa25ad6947 None None] [instance: 1f167a1d-4fc5-4938-bb6e-e0fbb90b542a] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:34:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:34:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-changed-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Refreshing instance network info cache due to event network-changed-ff13ce03-00ec-46df-b963-127cea573a4b. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:35:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] Acquiring lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:35:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] Acquired lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:35:06 user nova-compute[73503]: DEBUG nova.network.neutron [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Refreshing network info cache for port ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "a851a51f-69aa-4580-bc92-f23485b352eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:07 user nova-compute[73503]: INFO nova.compute.manager [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Terminating instance
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.compute.manager [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.network.neutron [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updated VIF entry in instance network info cache for port ff13ce03-00ec-46df-b963-127cea573a4b. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.network.neutron [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updating instance_info_cache with network_info: [{"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1abdd0a2-c23a-4d55-94a1-70c6f59607bb req-ea0f27d1-a120-4b04-8ac6-a3cf560b9ebe service nova] Releasing lock "refresh_cache-a851a51f-69aa-4580-bc92-f23485b352eb" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Instance destroyed successfully.
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.objects.instance [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'resources' on Instance uuid a851a51f-69aa-4580-bc92-f23485b352eb {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1988599469',display_name='tempest-TestVolumeBootPattern-server-1988599469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1988599469',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-f03ust3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:33:31Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=a851a51f-69aa-4580-bc92-f23485b352eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "ff13ce03-00ec-46df-b963-127cea573a4b", "address": "fa:16:3e:53:65:c5", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff13ce03-00", "ovs_interfaceid": "ff13ce03-00ec-46df-b963-127cea573a4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_vif [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff13ce03-00, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:07 user nova-compute[73503]: INFO os_vif [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:65:c5,bridge_name='br-int',has_traffic_filtering=True,id=ff13ce03-00ec-46df-b963-127cea573a4b,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff13ce03-00')
Aug 26 13:35:07 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:35:07 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7195f5b9-b757-465d-b2bb-ba1f2e5239bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d55d6b6-04a3-4595-a140-9ffbab3ab9d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:07 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:35:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:07 user nova-compute[73503]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:35:07 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3043813f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'): ({'sdd'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Removing single pathed devices sdd {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:35:07 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3390b115-1c74-4e49-b393-72d67e0b1e2d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b2f00-7c33-407b-9a29-4274bc36acca]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flushing IO for device /dev/sdd {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb126b0-999c-4708-b716-3dcf079916bd]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c673efa2-cbe3-46b1-8ed4-17e8a050b592]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd82579ea-3306988890727cfb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d82579ea', '/dev/disk/by-id/scsi-23333303639383838') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[896fabd5-4683-4b24-9c82-1b73f0a5f650]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a63786-ac90-4ad7-87b1-04ba1f37c12a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1cac1b-036b-464b-982f-ce2090734afa]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]
Aug 26 13:35:08 user nova-compute[73503]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.
Aug 26 13:35:08 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad559718-915c-48cf-9cfd-39b97fb65d10]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== disconnect_volume: return (287ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:35:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Deleting instance files /opt/stack/data/nova/instances/a851a51f-69aa-4580-bc92-f23485b352eb_del
Aug 26 13:35:08 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Deletion of /opt/stack/data/nova/instances/a851a51f-69aa-4580-bc92-f23485b352eb_del complete
Aug 26 13:35:08 user nova-compute[73503]: INFO nova.compute.manager [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-vif-unplugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] No waiting events found dispatching network-vif-unplugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-vif-unplugged-ff13ce03-00ec-46df-b963-127cea573a4b for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] Acquiring lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] Lock "a851a51f-69aa-4580-bc92-f23485b352eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] No waiting events found dispatching network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:08 user nova-compute[73503]: WARNING nova.compute.manager [req-1b55de1b-eb94-49dd-948b-f468032750bd req-2507f1ec-9fc4-4192-9e89-e890de7225e3 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received unexpected event network-vif-plugged-ff13ce03-00ec-46df-b963-127cea573a4b for instance with vm_state active and task_state deleting.
Aug 26 13:35:09 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:09 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Took 0.89 seconds to deallocate network for instance.
Aug 26 13:35:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-6fd05424-766a-42a5-9366-79d5603a433b req-63cccdfb-30d7-416b-801b-4db5e4286af8 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Received event network-vif-deleted-ff13ce03-00ec-46df-b963-127cea573a4b {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:09 user nova-compute[73503]: INFO nova.compute.manager [req-6fd05424-766a-42a5-9366-79d5603a433b req-63cccdfb-30d7-416b-801b-4db5e4286af8 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Neutron deleted interface ff13ce03-00ec-46df-b963-127cea573a4b; detaching it from the instance and deleting it from the info cache
Aug 26 13:35:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-6fd05424-766a-42a5-9366-79d5603a433b req-63cccdfb-30d7-416b-801b-4db5e4286af8 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:09 user nova-compute[73503]: DEBUG nova.compute.manager [req-6fd05424-766a-42a5-9366-79d5603a433b req-63cccdfb-30d7-416b-801b-4db5e4286af8 service nova] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Detach interface failed, port_id=ff13ce03-00ec-46df-b963-127cea573a4b, reason: Instance a851a51f-69aa-4580-bc92-f23485b352eb could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:35:09 user nova-compute[73503]: INFO nova.compute.manager [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Took 0.78 seconds to detach 1 volumes for instance.
Aug 26 13:35:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:10 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:35:10 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:35:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:10 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Deleted allocations for instance a851a51f-69aa-4580-bc92-f23485b352eb
Aug 26 13:35:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-bb46ad3a-6517-4fe3-a240-46f3824f39b5 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "a851a51f-69aa-4580-bc92-f23485b352eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.317s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:35:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:35:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:35:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:35:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:35:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:18 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:35:18 user nova-compute[73503]: INFO nova.compute.claims [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Claim successful on node user
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.network.neutron [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:35:19 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.policy [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeb38c05c97845f2b48b81aa5202945b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576be623b4ce46609c0ffee21379fd9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:35:19 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Creating image(s)
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "/opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "/opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk 1073741824" returned: 0 in 0.068s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG nova.network.neutron [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Successfully created port: b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Cannot resize image /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Ensure instance console log exists: /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Successfully updated port: b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquired lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-changed-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Refreshing instance network info cache due to event network-changed-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] Acquiring lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG nova.network.neutron [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:35:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updating instance_info_cache with network_info: [{"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Releasing lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Instance network_info: |[{"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] Acquired lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Refreshing network info cache for port b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Start _get_guest_xml network_info=[{"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:35:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:35:22 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:35:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-482095829',display_name='tempest-VolumesSnapshotTestJSON-instance-482095829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-482095829',id=44,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGRBy+or9cWSpC+1/RxL1CV/iQcVkHd10kHxK2iHN0LPUkxGQgP7XXopGDeD9jG0IyA9PnFhWn+fQoU5ZdgKneNf2QMwTaIAMvIYmcKm2JWke64t/jNWIMCkQ/S5SIeyg==',key_name='tempest-keypair-1475268475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576be623b4ce46609c0ffee21379fd9d',ramdisk_id='',reservation_id='r-skwbih5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1292919532',owner_user_name='tempest-VolumesSnapshotTestJSON-1292919532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb38c05c97845f2b48b81aa5202945b',uuid=7b7cc387-2147-4cbe-bd1d-e3a5fd593b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converting VIF {"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:35:22 user nova-compute[73503]:   <uuid>7b7cc387-2147-4cbe-bd1d-e3a5fd593b05</uuid>
Aug 26 13:35:22 user nova-compute[73503]:   <name>instance-0000002c</name>
Aug 26 13:35:22 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:35:22 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:35:22 user nova-compute[73503]:   <metadata>
Aug 26 13:35:22 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:35:22 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:35:22 user nova-compute[73503]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-482095829</nova:name>
Aug 26 13:35:22 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:35:22</nova:creationTime>
Aug 26 13:35:22 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:35:22 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:35:22 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:35:22 user nova-compute[73503]:       <nova:owner>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:user uuid="aeb38c05c97845f2b48b81aa5202945b">tempest-VolumesSnapshotTestJSON-1292919532-project-member</nova:user>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:project uuid="576be623b4ce46609c0ffee21379fd9d">tempest-VolumesSnapshotTestJSON-1292919532</nova:project>
Aug 26 13:35:22 user nova-compute[73503]:       </nova:owner>
Aug 26 13:35:22 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:35:22 user nova-compute[73503]:       <nova:ports>
Aug 26 13:35:22 user nova-compute[73503]:         <nova:port uuid="b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd">
Aug 26 13:35:22 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 13:35:22 user nova-compute[73503]:         </nova:port>
Aug 26 13:35:22 user nova-compute[73503]:       </nova:ports>
Aug 26 13:35:22 user nova-compute[73503]:     </nova:instance>
Aug 26 13:35:22 user nova-compute[73503]:   </metadata>
Aug 26 13:35:22 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:35:22 user nova-compute[73503]:     <system>
Aug 26 13:35:22 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:35:22 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:35:22 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:35:22 user nova-compute[73503]:       <entry name="serial">7b7cc387-2147-4cbe-bd1d-e3a5fd593b05</entry>
Aug 26 13:35:22 user nova-compute[73503]:       <entry name="uuid">7b7cc387-2147-4cbe-bd1d-e3a5fd593b05</entry>
Aug 26 13:35:22 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:35:22 user nova-compute[73503]:     </system>
Aug 26 13:35:22 user nova-compute[73503]:   </sysinfo>
Aug 26 13:35:22 user nova-compute[73503]:   <os>
Aug 26 13:35:22 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:35:22 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:35:22 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:35:22 user nova-compute[73503]:   </os>
Aug 26 13:35:22 user nova-compute[73503]:   <features>
Aug 26 13:35:22 user nova-compute[73503]:     <acpi/>
Aug 26 13:35:22 user nova-compute[73503]:     <apic/>
Aug 26 13:35:22 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:35:22 user nova-compute[73503]:   </features>
Aug 26 13:35:22 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:35:22 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:35:22 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:35:22 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:35:22 user nova-compute[73503]:   </clock>
Aug 26 13:35:22 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:35:22 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:35:22 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:35:22 user nova-compute[73503]:   </cpu>
Aug 26 13:35:22 user nova-compute[73503]:   <devices>
Aug 26 13:35:22 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:35:22 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:35:22 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk"/>
Aug 26 13:35:22 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:35:22 user nova-compute[73503]:     </disk>
Aug 26 13:35:22 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:35:22 user nova-compute[73503]:       <mac address="fa:16:3e:52:80:c3"/>
Aug 26 13:35:22 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:35:22 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:35:22 user nova-compute[73503]:       <target dev="tapb2ff7ec2-5b"/>
Aug 26 13:35:22 user nova-compute[73503]:     </interface>
Aug 26 13:35:22 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:35:22 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/console.log" append="off"/>
Aug 26 13:35:22 user nova-compute[73503]:     </serial>
Aug 26 13:35:22 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:35:22 user nova-compute[73503]:     <video>
Aug 26 13:35:22 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:35:22 user nova-compute[73503]:     </video>
Aug 26 13:35:22 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:35:22 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:35:22 user nova-compute[73503]:     </rng>
Aug 26 13:35:22 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:35:22 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:35:22 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:35:22 user nova-compute[73503]:     </memballoon>
Aug 26 13:35:22 user nova-compute[73503]:   </devices>
Aug 26 13:35:22 user nova-compute[73503]: </domain>
Aug 26 13:35:22 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:35:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-482095829',display_name='tempest-VolumesSnapshotTestJSON-instance-482095829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-482095829',id=44,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGRBy+or9cWSpC+1/RxL1CV/iQcVkHd10kHxK2iHN0LPUkxGQgP7XXopGDeD9jG0IyA9PnFhWn+fQoU5ZdgKneNf2QMwTaIAMvIYmcKm2JWke64t/jNWIMCkQ/S5SIeyg==',key_name='tempest-keypair-1475268475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='576be623b4ce46609c0ffee21379fd9d',ramdisk_id='',reservation_id='r-skwbih5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1292919532',owner_user_name='tempest-VolumesSnapshotTestJSON-1292919532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:35:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb38c05c97845f2b48b81aa5202945b',uuid=7b7cc387-2147-4cbe-bd1d-e3a5fd593b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converting VIF {"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG os_vif [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2ff7ec2-5b, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2ff7ec2-5b, col_values=(('external_ids', {'iface-id': 'b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:80:c3', 'vm-uuid': '7b7cc387-2147-4cbe-bd1d-e3a5fd593b05'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:22 user nova-compute[73503]: INFO os_vif [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b')
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No VIF found with MAC fa:16:3e:52:80:c3, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updated VIF entry in instance network info cache for port b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.network.neutron [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updating instance_info_cache with network_info: [{"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a08fc2e5-fd59-44ac-aac7-4ed7b499a3d6 req-a206966e-9647-4a9e-8808-a14860f3e5ca service nova] Releasing lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056907.899942, a851a51f-69aa-4580-bc92-f23485b352eb => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:22 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] VM Stopped (Lifecycle Event)
Aug 26 13:35:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-e7aacfae-2a43-4a22-bc81-c7041c7bfeb6 None None] [instance: a851a51f-69aa-4580-bc92-f23485b352eb] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-69b8cfbe-424f-433c-87f9-cc8f2de1f28d req-3ef9017f-bd3d-4a12-aa47-c829c3b3c68a service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69b8cfbe-424f-433c-87f9-cc8f2de1f28d req-3ef9017f-bd3d-4a12-aa47-c829c3b3c68a service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69b8cfbe-424f-433c-87f9-cc8f2de1f28d req-3ef9017f-bd3d-4a12-aa47-c829c3b3c68a service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69b8cfbe-424f-433c-87f9-cc8f2de1f28d req-3ef9017f-bd3d-4a12-aa47-c829c3b3c68a service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-69b8cfbe-424f-433c-87f9-cc8f2de1f28d req-3ef9017f-bd3d-4a12-aa47-c829c3b3c68a service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:23 user nova-compute[73503]: WARNING nova.compute.manager [req-69b8cfbe-424f-433c-87f9-cc8f2de1f28d req-3ef9017f-bd3d-4a12-aa47-c829c3b3c68a service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state building and task_state spawning.
Aug 26 13:35:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056925.7947135, 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:25 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] VM Resumed (Lifecycle Event)
Aug 26 13:35:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Instance spawned successfully.
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:35:25 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056925.7949588, 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:25 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] VM Started (Lifecycle Event)
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:35:25 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:35:25 user nova-compute[73503]: INFO nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Took 6.26 seconds to spawn the instance on the hypervisor.
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-3dc5633c-840b-4eed-865a-2e9660768ab8 req-e3028b45-e607-4d8d-b9a7-b4f3e43ea74f service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3dc5633c-840b-4eed-865a-2e9660768ab8 req-e3028b45-e607-4d8d-b9a7-b4f3e43ea74f service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3dc5633c-840b-4eed-865a-2e9660768ab8 req-e3028b45-e607-4d8d-b9a7-b4f3e43ea74f service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3dc5633c-840b-4eed-865a-2e9660768ab8 req-e3028b45-e607-4d8d-b9a7-b4f3e43ea74f service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-3dc5633c-840b-4eed-865a-2e9660768ab8 req-e3028b45-e607-4d8d-b9a7-b4f3e43ea74f service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:25 user nova-compute[73503]: WARNING nova.compute.manager [req-3dc5633c-840b-4eed-865a-2e9660768ab8 req-e3028b45-e607-4d8d-b9a7-b4f3e43ea74f service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state building and task_state spawning.
Aug 26 13:35:26 user nova-compute[73503]: INFO nova.compute.manager [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Took 7.10 seconds to build instance.
Aug 26 13:35:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-58e9d86b-0096-4cdd-aa6d-d52469d780d4 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.197s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:26 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:35:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:35:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:35:26 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:35:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:27 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:35:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:28 user nova-compute[73503]: INFO nova.compute.manager [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Terminating instance
Aug 26 13:35:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-56ac3886-cbf9-4037-8646-d4cccdc4b916 req-da9084e7-cbe4-4c85-82d3-1dc05783ecdb service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-vif-unplugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-56ac3886-cbf9-4037-8646-d4cccdc4b916 req-da9084e7-cbe4-4c85-82d3-1dc05783ecdb service nova] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-56ac3886-cbf9-4037-8646-d4cccdc4b916 req-da9084e7-cbe4-4c85-82d3-1dc05783ecdb service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-56ac3886-cbf9-4037-8646-d4cccdc4b916 req-da9084e7-cbe4-4c85-82d3-1dc05783ecdb service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-56ac3886-cbf9-4037-8646-d4cccdc4b916 req-da9084e7-cbe4-4c85-82d3-1dc05783ecdb service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] No waiting events found dispatching network-vif-unplugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-56ac3886-cbf9-4037-8646-d4cccdc4b916 req-da9084e7-cbe4-4c85-82d3-1dc05783ecdb service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-vif-unplugged-42d01d63-729f-4a4a-aa65-c20715619d37 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Instance destroyed successfully.
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.objects.instance [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lazy-loading 'resources' on Instance uuid 0f52dfe3-0414-40eb-8958-8c73dab19ff2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:32:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109442013',display_name='tempest-AttachVolumeNegativeTest-server-109442013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109442013',id=42,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuk2RlhbZaz7IP9BN5xUpj8xWgmkzkhkHeOhwAb6NR/jHV4Q7bOPrv6GndPxJMwPhw2HPmefdEzznxneYpGNTfaI8hehpJCam+tzLGPJyxjOkP8R7jJ5q97IvEWUm2Z/A==',key_name='tempest-keypair-1875760510',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:32:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e80f2c62e0a4494816b02e60073bb0e',ramdisk_id='',reservation_id='r-482gq5w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2059589668',owner_user_name='tempest-AttachVolumeNegativeTest-2059589668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8239f95979394225b8c80579a8121631',uuid=0f52dfe3-0414-40eb-8958-8c73dab19ff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converting VIF {"id": "42d01d63-729f-4a4a-aa65-c20715619d37", "address": "fa:16:3e:b1:cd:e5", "network": {"id": "63694744-8d23-47bf-a9bd-7b7379c130fc", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-445921111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e80f2c62e0a4494816b02e60073bb0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d01d63-72", "ovs_interfaceid": "42d01d63-729f-4a4a-aa65-c20715619d37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG os_vif [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42d01d63-72, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:35:29 user nova-compute[73503]: INFO os_vif [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:cd:e5,bridge_name='br-int',has_traffic_filtering=True,id=42d01d63-729f-4a4a-aa65-c20715619d37,network=Network(63694744-8d23-47bf-a9bd-7b7379c130fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d01d63-72')
Aug 26 13:35:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Deleting instance files /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2_del
Aug 26 13:35:29 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Deletion of /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2_del complete
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f52dfe3-0414-40eb-8958-8c73dab19ff2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:29 user nova-compute[73503]: INFO nova.compute.manager [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:29 user nova-compute[73503]: INFO nova.compute.manager [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Terminating instance
Aug 26 13:35:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-63c4373e-a435-41b1-91b0-014772ad599c req-e48c5292-2fdd-465f-bdd6-140771759660 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-vif-unplugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-63c4373e-a435-41b1-91b0-014772ad599c req-e48c5292-2fdd-465f-bdd6-140771759660 service nova] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-63c4373e-a435-41b1-91b0-014772ad599c req-e48c5292-2fdd-465f-bdd6-140771759660 service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-63c4373e-a435-41b1-91b0-014772ad599c req-e48c5292-2fdd-465f-bdd6-140771759660 service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-63c4373e-a435-41b1-91b0-014772ad599c req-e48c5292-2fdd-465f-bdd6-140771759660 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] No waiting events found dispatching network-vif-unplugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.compute.manager [req-63c4373e-a435-41b1-91b0-014772ad599c req-e48c5292-2fdd-465f-bdd6-140771759660 service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-vif-unplugged-091e82ff-8900-424d-83be-6044ae067340 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Instance destroyed successfully.
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'resources' on Instance uuid d0fab249-2251-46e5-8b6e-83df64db1cf2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:26:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-198714207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-198714207',id=31,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:26:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-f2fxyni7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:28:04Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=d0fab249-2251-46e5-8b6e-83df64db1cf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "091e82ff-8900-424d-83be-6044ae067340", "address": "fa:16:3e:7f:92:c3", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091e82ff-89", "ovs_interfaceid": "091e82ff-8900-424d-83be-6044ae067340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG os_vif [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091e82ff-89, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:35:30 user nova-compute[73503]: INFO os_vif [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:92:c3,bridge_name='br-int',has_traffic_filtering=True,id=091e82ff-8900-424d-83be-6044ae067340,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091e82ff-89')
Aug 26 13:35:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Deleting instance files /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2_del
Aug 26 13:35:30 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Deletion of /opt/stack/data/nova/instances/d0fab249-2251-46e5-8b6e-83df64db1cf2_del complete
Aug 26 13:35:30 user nova-compute[73503]: INFO nova.compute.manager [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:31 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Took 1.29 seconds to deallocate network for instance.
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] Acquiring lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] No waiting events found dispatching network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:31 user nova-compute[73503]: WARNING nova.compute.manager [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received unexpected event network-vif-plugged-42d01d63-729f-4a4a-aa65-c20715619d37 for instance with vm_state deleted and task_state None.
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.compute.manager [req-8c97cf45-f0ff-4fc9-b1e4-c64609f88a43 req-0686323d-0b04-4348-99bf-47f87fa7cb36 service nova] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Received event network-vif-deleted-42d01d63-729f-4a4a-aa65-c20715619d37 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:31 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Took 0.72 seconds to deallocate network for instance.
Aug 26 13:35:31 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Deleted allocations for instance 0f52dfe3-0414-40eb-8958-8c73dab19ff2
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-30eb0818-645e-48e3-80ed-be9fc1b84c45 tempest-AttachVolumeNegativeTest-2059589668 tempest-AttachVolumeNegativeTest-2059589668-project-member] Lock "0f52dfe3-0414-40eb-8958-8c73dab19ff2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.328s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:32 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:35:32 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8152MB free_disk=24.827125549316406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-d92ecb63-a3a6-4595-aac7-9b07d03e14b0 req-e70817db-377d-4638-b1bd-7f4e6b338a2d service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d92ecb63-a3a6-4595-aac7-9b07d03e14b0 req-e70817db-377d-4638-b1bd-7f4e6b338a2d service nova] Acquiring lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d92ecb63-a3a6-4595-aac7-9b07d03e14b0 req-e70817db-377d-4638-b1bd-7f4e6b338a2d service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d92ecb63-a3a6-4595-aac7-9b07d03e14b0 req-e70817db-377d-4638-b1bd-7f4e6b338a2d service nova] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.manager [req-d92ecb63-a3a6-4595-aac7-9b07d03e14b0 req-e70817db-377d-4638-b1bd-7f4e6b338a2d service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] No waiting events found dispatching network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:32 user nova-compute[73503]: WARNING nova.compute.manager [req-d92ecb63-a3a6-4595-aac7-9b07d03e14b0 req-e70817db-377d-4638-b1bd-7f4e6b338a2d service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received unexpected event network-vif-plugged-091e82ff-8900-424d-83be-6044ae067340 for instance with vm_state deleted and task_state None.
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.209s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:32 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Deleted allocations for instance d0fab249-2251-46e5-8b6e-83df64db1cf2
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 6472acd9-81af-48fe-9650-0cfb8146dbd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9e50114a-196d-4293-adb6-ab9f4cf15f83 tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "d0fab249-2251-46e5-8b6e-83df64db1cf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:35:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:33 user nova-compute[73503]: DEBUG nova.compute.manager [req-2297834d-b41e-411c-b887-6d059b1f0278 req-13a8fc8b-a866-4d5f-8572-c54b971de28c service nova] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Received event network-vif-deleted-091e82ff-8900-424d-83be-6044ae067340 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'flavor' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:35 user nova-compute[73503]: INFO nova.compute.manager [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Attaching volume e1197013-2919-406c-9676-65e23bdba133 to /dev/vdb
Aug 26 13:35:35 user nova-compute[73503]: DEBUG os_brick.utils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac551991-c1ad-4e6e-93cd-679d953235ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfec7c0-d13d-4711-b71d-ab12138a2428]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c63e7c4-2f61-47b1-b381-d251e5dcd114]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb27b70b-828e-4325-8d86-3bb41a31e6fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:35:35 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:35:35 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65a2f11-6e8b-49f1-b6d4-d03855261510]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG os_brick.utils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:35:35 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating existing volume attachment record: 7a09bbf7-fcbb-4a2f-83c3-f6731d6bf6e2 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:35:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:35:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:35:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:35:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:35:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:44 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056929.6141531, 0f52dfe3-0414-40eb-8958-8c73dab19ff2 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:44 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] VM Stopped (Lifecycle Event)
Aug 26 13:35:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7fe0f4fb-e982-402a-9275-432ef24c3b16 None None] [instance: 0f52dfe3-0414-40eb-8958-8c73dab19ff2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:45 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056930.6417618, d0fab249-2251-46e5-8b6e-83df64db1cf2 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:45 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] VM Stopped (Lifecycle Event)
Aug 26 13:35:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c91c0e59-d41b-4f19-95c4-dce50c560056 None None] [instance: d0fab249-2251-46e5-8b6e-83df64db1cf2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpWISeTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:35:47 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:35:47 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:35:47 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[996c8915-1b57-4a05-b6f9-8938c3b8b97b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:35:47 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[945c4235-43ec-4dfb-af59-9018a3386dbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133] added
Aug 26 13:35:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805b053-40e2-42c2-a2fd-50462f264cbb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f96c4-1944-4d29-bf1a-5097cfc25ecc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JpWISeTi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JpWISeTi" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe66e6d4-1704-4b60-93ab-b07e7b4903a3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JpWISeTi'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5c64a-9622-4aa5-a465-0bdb875c6dc4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e92fa-8b79-4332-bcb2-09efb3c5be70]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28382e-85d3-4ded-98db-55336fe8dd68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260]
Aug 26 13:35:47 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260] successful.
Aug 26 13:35:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c893f4-efd6-4034-baee-35b777f958a8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115532c-8f51-44c2-ad4c-7a63771e7a48]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:47 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:35:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:47 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:35:47 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8da5f8-eff7-4b4b-8cd5-f27f65fe031a]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:47 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpWISeTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23866623561346231', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866623561346231', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'flavor' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:35:48 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:35:48 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:35:48 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:35:48 user nova-compute[73503]:   <serial>e1197013-2919-406c-9676-65e23bdba133</serial>
Aug 26 13:35:48 user nova-compute[73503]: </disk>
Aug 26 13:35:48 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:35:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:35:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:35:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No VIF found with MAC fa:16:3e:04:ff:20, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:35:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4eb5c120-02e4-4f0a-bb16-ed34129fceb0 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.686s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:49 user nova-compute[73503]: INFO nova.compute.manager [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Rescuing
Aug 26 13:35:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:35:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:35:49 user nova-compute[73503]: DEBUG nova.network.neutron [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-b99c6c63-7d98-4847-b729-5005e110e062 req-80810216-153b-4be6-83ab-b06f70a938de service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b99c6c63-7d98-4847-b729-5005e110e062 req-80810216-153b-4be6-83ab-b06f70a938de service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b99c6c63-7d98-4847-b729-5005e110e062 req-80810216-153b-4be6-83ab-b06f70a938de service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b99c6c63-7d98-4847-b729-5005e110e062 req-80810216-153b-4be6-83ab-b06f70a938de service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:50 user nova-compute[73503]: DEBUG nova.compute.manager [req-b99c6c63-7d98-4847-b729-5005e110e062 req-80810216-153b-4be6-83ab-b06f70a938de service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:50 user nova-compute[73503]: WARNING nova.compute.manager [req-b99c6c63-7d98-4847-b729-5005e110e062 req-80810216-153b-4be6-83ab-b06f70a938de service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state active and task_state rescuing.
Aug 26 13:35:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance destroyed successfully.
Aug 26 13:35:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Attempting a stable device rescue
Aug 26 13:35:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73503) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 13:35:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance directory exists: not creating {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 13:35:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Creating image(s)
Aug 26 13:35:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:51 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'trusted_certs' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "acbd386df1b58e3326b989074c5b75f2e21465a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "acbd386df1b58e3326b989074c5b75f2e21465a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-022bc1f5-1e65-48ba-94f3-78ac2970f9fd req-58c90388-3711-4bd9-8f46-a45b130c790b service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-022bc1f5-1e65-48ba-94f3-78ac2970f9fd req-58c90388-3711-4bd9-8f46-a45b130c790b service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-022bc1f5-1e65-48ba-94f3-78ac2970f9fd req-58c90388-3711-4bd9-8f46-a45b130c790b service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-022bc1f5-1e65-48ba-94f3-78ac2970f9fd req-58c90388-3711-4bd9-8f46-a45b130c790b service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-022bc1f5-1e65-48ba-94f3-78ac2970f9fd req-58c90388-3711-4bd9-8f46-a45b130c790b service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:52 user nova-compute[73503]: WARNING nova.compute.manager [req-022bc1f5-1e65-48ba-94f3-78ac2970f9fd req-58c90388-3711-4bd9-8f46-a45b130c790b service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state active and task_state rescuing.
Aug 26 13:35:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.part --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG nova.virt.images [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] 86e6c82e-356c-4f5f-8c58-4c491c81117b was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:35:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.part /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.part /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.converted" returned: 0 in 0.781s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "acbd386df1b58e3326b989074c5b75f2e21465a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.450s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "acbd386df1b58e3326b989074c5b75f2e21465a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "acbd386df1b58e3326b989074c5b75f2e21465a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0 --force-share --output=json" returned: 0 in 0.167s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0,backing_fmt=raw /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0,backing_fmt=raw /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue" returned: 0 in 0.055s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "acbd386df1b58e3326b989074c5b75f2e21465a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'migration_context' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Object Instance<794e9828-4b77-4d11-84b8-5505e579949d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Start _get_guest_xml network_info=[{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "vif_mac": "fa:16:3e:04:ff:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '86e6c82e-356c-4f5f-8c58-4c491c81117b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpWISeTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '794e9828-4b77-4d11-84b8-5505e579949d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1197013-2919-406c-9676-65e23bdba133', 'serial': 'e1197013-2919-406c-9676-65e23bdba133'}, 'attachment_id': '7a09bbf7-fcbb-4a2f-83c3-f6731d6bf6e2', 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'resources' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Object Instance<794e9828-4b77-4d11-84b8-5505e579949d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'numa_topology' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Object Instance<794e9828-4b77-4d11-84b8-5505e579949d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:35:54 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:35:54 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'vcpu_model' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Object Instance<794e9828-4b77-4d11-84b8-5505e579949d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpWISeTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:35:54 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:35:54 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:35:54 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b758046-7db3-4fd9-81c7-70f2fac3bfc4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JpWISeTi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 13:35:54 user nova-compute[73503]: node.name = iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133
Aug 26 13:35:54 user nova-compute[73503]: node.tpgt = -1
Aug 26 13:35:54 user nova-compute[73503]: node.startup = automatic
Aug 26 13:35:54 user nova-compute[73503]: node.leading_login = No
Aug 26 13:35:54 user nova-compute[73503]: iface.iscsi_ifacename = default
Aug 26 13:35:54 user nova-compute[73503]: iface.net_ifacename = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.ipaddress = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.prefix_len = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.hwaddress = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.transport_name = tcp
Aug 26 13:35:54 user nova-compute[73503]: iface.initiatorname = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.vlan_id = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.vlan_priority = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.vlan_state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.iface_num = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.mtu = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.port = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.bootproto = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.subnet_mask = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.gateway = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_alt_client_id = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_dns = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_learn_iqn = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_vendor_id_state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_vendor_id = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.dhcp_slp_da = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.fragmentation = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.gratuitous_arp = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.incoming_forwarding = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.tos_state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.tos = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.ttl = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.delayed_ack = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.tcp_nagle = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.tcp_wsf_state = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.tcp_wsf = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.tcp_timer_scale = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.tcp_timestamp = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.redirect = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.def_task_mgmt_timeout = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.header_digest = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.data_digest = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.immediate_data = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.initial_r2t = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.data_seq_inorder = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.data_pdu_inorder = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.erl = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.max_receive_data_len = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.first_burst_len = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.max_outstanding_r2t = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.max_burst_len = 0
Aug 26 13:35:54 user nova-compute[73503]: iface.chap_auth = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.bidi_chap = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.strict_login_compliance = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.discovery_auth = <empty>
Aug 26 13:35:54 user nova-compute[73503]: iface.discovery_logout = <empty>
Aug 26 13:35:54 user nova-compute[73503]: node.discovery_address = <empty>
Aug 26 13:35:54 user nova-compute[73503]: node.discovery_port = 0
Aug 26 13:35:54 user nova-compute[73503]: node.discovery_type = static
Aug 26 13:35:54 user nova-compute[73503]: node.session.initial_cmdsn = 0
Aug 26 13:35:54 user nova-compute[73503]: node.session.initial_login_retry_max = 8
Aug 26 13:35:54 user nova-compute[73503]: node.session.xmit_thread_priority = -20
Aug 26 13:35:54 user nova-compute[73503]: node.session.cmds_max = 128
Aug 26 13:35:54 user nova-compute[73503]: node.session.queue_depth = 32
Aug 26 13:35:54 user nova-compute[73503]: node.session.nr_sessions = 1
Aug 26 13:35:54 user nova-compute[73503]: node.session.auth.authmethod = CHAP
Aug 26 13:35:54 user nova-compute[73503]: node.session.auth.username = JpWISeTi
Aug 26 13:35:54 user nova-compute[73503]: node.session.auth.password = ***
Aug 26 13:35:54 user nova-compute[73503]: node.session.auth.username_in = <empty>
Aug 26 13:35:54 user nova-compute[73503]: node.session.auth.password_in = <empty>
Aug 26 13:35:54 user nova-compute[73503]: node.session.auth.chap_algs = MD5
Aug 26 13:35:54 user nova-compute[73503]: node.session.timeo.replacement_timeout = 120
Aug 26 13:35:54 user nova-compute[73503]: node.session.err_timeo.abort_timeout = 15
Aug 26 13:35:54 user nova-compute[73503]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 13:35:54 user nova-compute[73503]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 13:35:54 user nova-compute[73503]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.FastAbort = Yes
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.InitialR2T = No
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.ImmediateData = Yes
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.MaxConnections = 1
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 13:35:54 user nova-compute[73503]: node.session.iscsi.ERL = 0
Aug 26 13:35:54 user nova-compute[73503]: node.session.scan = manual
Aug 26 13:35:54 user nova-compute[73503]: node.session.reopen_max = 0
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].address = 172.16.0.220
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].port = 3260
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].startup = manual
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].tcp.window_size = 524288
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].tcp.type_of_service = 0
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].timeo.logout_timeout = 15
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].timeo.login_timeout = 15
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].timeo.auth_timeout = 45
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].iscsi.DataDigest = None
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].iscsi.IFMarker = No
Aug 26 13:35:54 user nova-compute[73503]: node.conn[0].iscsi.OFMarker = No
Aug 26 13:35:54 user nova-compute[73503]: # END RECORD
Aug 26 13:35:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d1ab6-8476-4c79-b5a3-1eca860983e8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[635c89e9-b6b0-4caf-818c-0b91f1e735fb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JpWISeTi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JpWISeTi" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba703fb-a211-4e78-961a-0987c56a50bb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JpWISeTi'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaa5a4e-7a8f-42ab-9e9f-0c260b1b41b9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b37db6-7cf0-4ee4-8cf8-2909af30180c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:54 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:35:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:35:54 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:35:54 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] HCTL ('34', '0', '0', 0) found on session 48 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf9c18-1938-477a-b0ee-b85f254cf065]: (4, ('0 0 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Searching for a device in session 48 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpWISeTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.177s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23866623561346231', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866623561346231', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1286434629',display_name='tempest-ServerStableDeviceRescueTest-server-1286434629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1286434629',id=40,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO803v1ZnwGe07xuV97cGCa9PZQCHx8RnV8gWXHlFNzM6uT8JHsm0zj+rIlavQw4S5XCYFW4ZCIJ+8VEc/rW4EuidFxQS5ce2QH+tYKM68vrGW/bRUa5SRm5/UsjCHiwQg==',key_name='tempest-keypair-442917711',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:32:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c67b91da188457c8798f0a88c03590c',ramdisk_id='',reservation_id='r-yffjwf3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-903706850',owner_user_name='tempest-ServerStableDeviceRescueTest-903706850-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:33:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1c5d31dff424c929cd66ba7f031d889',uuid=794e9828-4b77-4d11-84b8-5505e579949d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "vif_mac": "fa:16:3e:04:ff:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converting VIF {"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "vif_mac": "fa:16:3e:04:ff:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'pci_devices' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.objects.base [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Object Instance<794e9828-4b77-4d11-84b8-5505e579949d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:35:54 user nova-compute[73503]:   <uuid>794e9828-4b77-4d11-84b8-5505e579949d</uuid>
Aug 26 13:35:54 user nova-compute[73503]:   <name>instance-00000028</name>
Aug 26 13:35:54 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:35:54 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:35:54 user nova-compute[73503]:   <metadata>
Aug 26 13:35:54 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:35:54 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:35:54 user nova-compute[73503]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1286434629</nova:name>
Aug 26 13:35:54 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:35:54</nova:creationTime>
Aug 26 13:35:54 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:35:54 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:35:54 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:35:54 user nova-compute[73503]:       <nova:owner>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:user uuid="e1c5d31dff424c929cd66ba7f031d889">tempest-ServerStableDeviceRescueTest-903706850-project-member</nova:user>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:project uuid="3c67b91da188457c8798f0a88c03590c">tempest-ServerStableDeviceRescueTest-903706850</nova:project>
Aug 26 13:35:54 user nova-compute[73503]:       </nova:owner>
Aug 26 13:35:54 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:35:54 user nova-compute[73503]:       <nova:ports>
Aug 26 13:35:54 user nova-compute[73503]:         <nova:port uuid="9cfd54a1-f3e1-4d51-bb9b-49aeeb786104">
Aug 26 13:35:54 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 13:35:54 user nova-compute[73503]:         </nova:port>
Aug 26 13:35:54 user nova-compute[73503]:       </nova:ports>
Aug 26 13:35:54 user nova-compute[73503]:     </nova:instance>
Aug 26 13:35:54 user nova-compute[73503]:   </metadata>
Aug 26 13:35:54 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:35:54 user nova-compute[73503]:     <system>
Aug 26 13:35:54 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:35:54 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:35:54 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:35:54 user nova-compute[73503]:       <entry name="serial">794e9828-4b77-4d11-84b8-5505e579949d</entry>
Aug 26 13:35:54 user nova-compute[73503]:       <entry name="uuid">794e9828-4b77-4d11-84b8-5505e579949d</entry>
Aug 26 13:35:54 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:35:54 user nova-compute[73503]:     </system>
Aug 26 13:35:54 user nova-compute[73503]:   </sysinfo>
Aug 26 13:35:54 user nova-compute[73503]:   <os>
Aug 26 13:35:54 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:35:54 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:35:54 user nova-compute[73503]:   </os>
Aug 26 13:35:54 user nova-compute[73503]:   <features>
Aug 26 13:35:54 user nova-compute[73503]:     <acpi/>
Aug 26 13:35:54 user nova-compute[73503]:     <apic/>
Aug 26 13:35:54 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:35:54 user nova-compute[73503]:   </features>
Aug 26 13:35:54 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:35:54 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:35:54 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:35:54 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:35:54 user nova-compute[73503]:   </clock>
Aug 26 13:35:54 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:35:54 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:35:54 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:35:54 user nova-compute[73503]:   </cpu>
Aug 26 13:35:54 user nova-compute[73503]:   <devices>
Aug 26 13:35:54 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:35:54 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:35:54 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk"/>
Aug 26 13:35:54 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:35:54 user nova-compute[73503]:     </disk>
Aug 26 13:35:54 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:35:54 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:35:54 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:35:54 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:35:54 user nova-compute[73503]:       <serial>e1197013-2919-406c-9676-65e23bdba133</serial>
Aug 26 13:35:54 user nova-compute[73503]:     </disk>
Aug 26 13:35:54 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:35:54 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:35:54 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue"/>
Aug 26 13:35:54 user nova-compute[73503]:       <target dev="vdc" bus="virtio"/>
Aug 26 13:35:54 user nova-compute[73503]:       <boot order="1"/>
Aug 26 13:35:54 user nova-compute[73503]:     </disk>
Aug 26 13:35:54 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:35:54 user nova-compute[73503]:       <mac address="fa:16:3e:04:ff:20"/>
Aug 26 13:35:54 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:35:54 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:35:54 user nova-compute[73503]:       <target dev="tap9cfd54a1-f3"/>
Aug 26 13:35:54 user nova-compute[73503]:     </interface>
Aug 26 13:35:54 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:35:54 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/console.log" append="off"/>
Aug 26 13:35:54 user nova-compute[73503]:     </serial>
Aug 26 13:35:54 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:35:54 user nova-compute[73503]:     <video>
Aug 26 13:35:54 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:35:54 user nova-compute[73503]:     </video>
Aug 26 13:35:54 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:35:54 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:35:54 user nova-compute[73503]:     </rng>
Aug 26 13:35:54 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:35:54 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:35:54 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:35:54 user nova-compute[73503]:     </memballoon>
Aug 26 13:35:54 user nova-compute[73503]:   </devices>
Aug 26 13:35:54 user nova-compute[73503]: </domain>
Aug 26 13:35:54 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:35:54 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance destroyed successfully.
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:35:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] No VIF found with MAC fa:16:3e:04:ff:20, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:35:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b1a08a2-f583-4292-8d71-5693f500e93a req-acff2738-3282-4a3a-94be-949bd7b3a16c service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b1a08a2-f583-4292-8d71-5693f500e93a req-acff2738-3282-4a3a-94be-949bd7b3a16c service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b1a08a2-f583-4292-8d71-5693f500e93a req-acff2738-3282-4a3a-94be-949bd7b3a16c service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0b1a08a2-f583-4292-8d71-5693f500e93a req-acff2738-3282-4a3a-94be-949bd7b3a16c service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:56 user nova-compute[73503]: DEBUG nova.compute.manager [req-0b1a08a2-f583-4292-8d71-5693f500e93a req-acff2738-3282-4a3a-94be-949bd7b3a16c service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:56 user nova-compute[73503]: WARNING nova.compute.manager [req-0b1a08a2-f583-4292-8d71-5693f500e93a req-acff2738-3282-4a3a-94be-949bd7b3a16c service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state active and task_state rescuing.
Aug 26 13:35:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 794e9828-4b77-4d11-84b8-5505e579949d due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056958.7032516, 794e9828-4b77-4d11-84b8-5505e579949d => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:58 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Resumed (Lifecycle Event)
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-db21e563-a0b1-45ef-a522-a8daee3d3ab5 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:35:58 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056958.713306, 794e9828-4b77-4d11-84b8-5505e579949d => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:35:58 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Started (Lifecycle Event)
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-f05f3e89-ccaf-49f0-9626-b2d47e51fdcd req-738ae6db-f9e8-480d-b927-c86fd8fd1535 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f05f3e89-ccaf-49f0-9626-b2d47e51fdcd req-738ae6db-f9e8-480d-b927-c86fd8fd1535 service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f05f3e89-ccaf-49f0-9626-b2d47e51fdcd req-738ae6db-f9e8-480d-b927-c86fd8fd1535 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f05f3e89-ccaf-49f0-9626-b2d47e51fdcd req-738ae6db-f9e8-480d-b927-c86fd8fd1535 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-f05f3e89-ccaf-49f0-9626-b2d47e51fdcd req-738ae6db-f9e8-480d-b927-c86fd8fd1535 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:35:58 user nova-compute[73503]: WARNING nova.compute.manager [req-f05f3e89-ccaf-49f0-9626-b2d47e51fdcd req-738ae6db-f9e8-480d-b927-c86fd8fd1535 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state active and task_state rescuing.
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:35:58 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dc382e76-a52b-47d7-8772-d795658d9f38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:35:59 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:35:59 user nova-compute[73503]: INFO nova.compute.claims [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Claim successful on node user
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.network.neutron [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:36:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:36:00 user nova-compute[73503]: INFO nova.virt.block_device [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Booting with volume 772e71f4-cbf8-4639-ad90-bc0b488454f2 at /dev/vda
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.policy [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122b92a79d3242f2903b15430240eace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c42bf18354f55954102eed4da2d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG os_brick.utils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd812b8-c565-4f4c-872d-ede1da3e60f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9432247d-a129-471a-8c89-c538ee47fb37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f58d20-7796-4f01-844c-d0e7fa4070d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab359b9f-4508-4b0e-9f99-53a42a511859]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:36:00 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:36:00 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f37bc1b-79ce-4658-98a0-ded1ce437e50]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG os_brick.utils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating existing volume attachment record: b4953819-e3dc-43c1-86ca-868f4395716c {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:36:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:01 user nova-compute[73503]: DEBUG nova.network.neutron [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Successfully created port: 238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:36:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Successfully updated port: 238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:36:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:36:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquired lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:36:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-changed-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Refreshing instance network info cache due to event network-changed-238f7459-6018-428d-a558-ed914d839f97. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] Acquiring lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Releasing lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Instance network_info: |[{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] Acquired lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Refreshing network info cache for port 238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updated VIF entry in instance network info cache for port 238f7459-6018-428d-a558-ed914d839f97. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:36:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ef65e5d0-052a-411d-bad8-fabb085dee3f req-f94f4d7b-8943-4a8c-bf42-b2bd7c0be995 service nova] Releasing lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:36:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:36:12 user nova-compute[73503]: INFO nova.compute.claims [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Claim successful on node user
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.network.neutron [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:36:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.policy [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '069e5b62e5904df6bef00673c3a83f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0839baf2914ad9a087bee16cf3e1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:36:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Creating image(s)
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "f68106e08994af2dd8159650bdcbfdbeaf2f8caa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "f68106e08994af2dd8159650bdcbfdbeaf2f8caa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.network.neutron [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Successfully created port: 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.part --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.images [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] 1d7aeddf-84ce-4c03-b40c-629ee10a512e was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.part /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:36:13 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Creating image(s)
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Ensure instance console log exists: /opt/stack/data/nova/instances/dc382e76-a52b-47d7-8772-d795658d9f38/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Start _get_guest_xml network_info=[{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc382e76-a52b-47d7-8772-d795658d9f38', 'attached_at': '', 'detached_at': '', 'volume_id': '772e71f4-cbf8-4639-ad90-bc0b488454f2', 'serial': '772e71f4-cbf8-4639-ad90-bc0b488454f2'}, 'attachment_id': 'b4953819-e3dc-43c1-86ca-868f4395716c', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:36:13 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:36:13 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:36:13 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:36:13 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:36:13 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bb477-d226-4723-b2ff-d386f65e46f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:36:13 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e7125-5be9-4515-9812-c24f98c14a8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2] added
Aug 26 13:36:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec1833f-fc8d-4b38-9b98-e80a03e88475]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.080s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0077035e-a2ca-4987-88f7-e99f1b05ef7d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIjrtcqV {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIjrtcqV" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0a0bf-df56-48b6-a651-b084dbe9fafb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIjrtcqV'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a4081-d7bc-483e-a375-ca24e343255a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149d868-fa6a-4588-9d2d-7f574fe2f420]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:36:13 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:36:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:36:13 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:36:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.part /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.converted" returned: 0 in 0.499s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846bbe6-eb40-45dc-ba5a-75b0c5739362]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]
Aug 26 13:36:13 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.
Aug 26 13:36:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[377365ac-30f8-4da6-9c03-de9c06663fdc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79a9c5-76e6-4b58-9211-516422ce1cd0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:36:13 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:36:13 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:36:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:36:13 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:36:13 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:36:13 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be75d0b-4680-4512-aa32-bb42f5da2f35]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:36:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "f68106e08994af2dd8159650bdcbfdbeaf2f8caa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.457s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Successfully updated port: 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "f68106e08994af2dd8159650bdcbfdbeaf2f8caa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "f68106e08994af2dd8159650bdcbfdbeaf2f8caa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.compute.manager [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing instance network info cache due to event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.neutron [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.neutron [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa,backing_fmt=raw /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa,backing_fmt=raw /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk 1073741824" returned: 0 in 0.052s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "f68106e08994af2dd8159650bdcbfdbeaf2f8caa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.neutron [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e07832ae-b200-423a-bf28-35c5b825bea0 req-172d2c10-13ea-4685-902b-de9c000a9a26 service nova] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.neutron [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Cannot resize image /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Ensure instance console log exists: /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23333303639383838', 'path': '/dev/sdd'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333303639383838', 'path': '/dev/sdd'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1426163395',display_name='tempest-TestVolumeBootPattern-server-1426163395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1426163395',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-iyzl35h2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:36:00Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=dc382e76-a52b-47d7-8772-d795658d9f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.objects.instance [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'pci_devices' on Instance uuid dc382e76-a52b-47d7-8772-d795658d9f38 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:36:14 user nova-compute[73503]:   <uuid>dc382e76-a52b-47d7-8772-d795658d9f38</uuid>
Aug 26 13:36:14 user nova-compute[73503]:   <name>instance-0000002d</name>
Aug 26 13:36:14 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:36:14 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:36:14 user nova-compute[73503]:   <metadata>
Aug 26 13:36:14 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:36:14 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:36:14 user nova-compute[73503]:       <nova:name>tempest-TestVolumeBootPattern-server-1426163395</nova:name>
Aug 26 13:36:14 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:36:13</nova:creationTime>
Aug 26 13:36:14 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:36:14 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:36:14 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:36:14 user nova-compute[73503]:       <nova:owner>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:user uuid="122b92a79d3242f2903b15430240eace">tempest-TestVolumeBootPattern-813053503-project-member</nova:user>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:project uuid="c56c42bf18354f55954102eed4da2d58">tempest-TestVolumeBootPattern-813053503</nova:project>
Aug 26 13:36:14 user nova-compute[73503]:       </nova:owner>
Aug 26 13:36:14 user nova-compute[73503]:       <nova:ports>
Aug 26 13:36:14 user nova-compute[73503]:         <nova:port uuid="238f7459-6018-428d-a558-ed914d839f97">
Aug 26 13:36:14 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 13:36:14 user nova-compute[73503]:         </nova:port>
Aug 26 13:36:14 user nova-compute[73503]:       </nova:ports>
Aug 26 13:36:14 user nova-compute[73503]:     </nova:instance>
Aug 26 13:36:14 user nova-compute[73503]:   </metadata>
Aug 26 13:36:14 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:36:14 user nova-compute[73503]:     <system>
Aug 26 13:36:14 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:36:14 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:36:14 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:36:14 user nova-compute[73503]:       <entry name="serial">dc382e76-a52b-47d7-8772-d795658d9f38</entry>
Aug 26 13:36:14 user nova-compute[73503]:       <entry name="uuid">dc382e76-a52b-47d7-8772-d795658d9f38</entry>
Aug 26 13:36:14 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:36:14 user nova-compute[73503]:     </system>
Aug 26 13:36:14 user nova-compute[73503]:   </sysinfo>
Aug 26 13:36:14 user nova-compute[73503]:   <os>
Aug 26 13:36:14 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:36:14 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:36:14 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:36:14 user nova-compute[73503]:   </os>
Aug 26 13:36:14 user nova-compute[73503]:   <features>
Aug 26 13:36:14 user nova-compute[73503]:     <acpi/>
Aug 26 13:36:14 user nova-compute[73503]:     <apic/>
Aug 26 13:36:14 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:36:14 user nova-compute[73503]:   </features>
Aug 26 13:36:14 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:36:14 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:36:14 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:36:14 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:36:14 user nova-compute[73503]:   </clock>
Aug 26 13:36:14 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:36:14 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:36:14 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:36:14 user nova-compute[73503]:   </cpu>
Aug 26 13:36:14 user nova-compute[73503]:   <devices>
Aug 26 13:36:14 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:36:14 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:36:14 user nova-compute[73503]:       <source dev="/dev/sdd"/>
Aug 26 13:36:14 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:36:14 user nova-compute[73503]:       <serial>772e71f4-cbf8-4639-ad90-bc0b488454f2</serial>
Aug 26 13:36:14 user nova-compute[73503]:     </disk>
Aug 26 13:36:14 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:36:14 user nova-compute[73503]:       <mac address="fa:16:3e:36:cc:fb"/>
Aug 26 13:36:14 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:36:14 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:36:14 user nova-compute[73503]:       <target dev="tap238f7459-60"/>
Aug 26 13:36:14 user nova-compute[73503]:     </interface>
Aug 26 13:36:14 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:36:14 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/dc382e76-a52b-47d7-8772-d795658d9f38/console.log" append="off"/>
Aug 26 13:36:14 user nova-compute[73503]:     </serial>
Aug 26 13:36:14 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:36:14 user nova-compute[73503]:     <video>
Aug 26 13:36:14 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:36:14 user nova-compute[73503]:     </video>
Aug 26 13:36:14 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:36:14 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:36:14 user nova-compute[73503]:     </rng>
Aug 26 13:36:14 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:36:14 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:36:14 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:36:14 user nova-compute[73503]:     </memballoon>
Aug 26 13:36:14 user nova-compute[73503]:   </devices>
Aug 26 13:36:14 user nova-compute[73503]: </domain>
Aug 26 13:36:14 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1426163395',display_name='tempest-TestVolumeBootPattern-server-1426163395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1426163395',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-iyzl35h2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:36:00Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=dc382e76-a52b-47d7-8772-d795658d9f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG os_vif [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap238f7459-60, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap238f7459-60, col_values=(('external_ids', {'iface-id': '238f7459-6018-428d-a558-ed914d839f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:cc:fb', 'vm-uuid': 'dc382e76-a52b-47d7-8772-d795658d9f38'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:15 user nova-compute[73503]: INFO os_vif [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60')
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No VIF found with MAC fa:16:3e:36:cc:fb, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.network.neutron [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance network_info: |[{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Start _get_guest_xml network_info=[{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:36:09Z,direct_url=<?>,disk_format='qcow2',id=1d7aeddf-84ce-4c03-b40c-629ee10a512e,min_disk=0,min_ram=0,name='tempest-scenario-img--2145128286',owner='af0839baf2914ad9a087bee16cf3e1b5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:36:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '1d7aeddf-84ce-4c03-b40c-629ee10a512e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:36:15 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:36:15 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:36:09Z,direct_url=<?>,disk_format='qcow2',id=1d7aeddf-84ce-4c03-b40c-629ee10a512e,min_disk=0,min_ram=0,name='tempest-scenario-img--2145128286',owner='af0839baf2914ad9a087bee16cf3e1b5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:36:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1717550581',display_name='tempest-TestMinimumBasicScenario-server-1717550581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1717550581',id=46,image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTLRC03UdEqg7pC+RsyF073pr4L5bFbWnL0sREFh8VfjtPojwgSml38ZRVKikdsDbTmuOTLdJMPcvN6R/BRbkL1Uw0qCc6I2ITlaIZNYaMjXJngr/BRCTEVUt8EoJIdPA==',key_name='tempest-TestMinimumBasicScenario-2116688177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-cz260b2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:36:12Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.objects.instance [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:36:15 user nova-compute[73503]:   <uuid>0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9</uuid>
Aug 26 13:36:15 user nova-compute[73503]:   <name>instance-0000002e</name>
Aug 26 13:36:15 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:36:15 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:36:15 user nova-compute[73503]:   <metadata>
Aug 26 13:36:15 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:36:15 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:36:15 user nova-compute[73503]:       <nova:name>tempest-TestMinimumBasicScenario-server-1717550581</nova:name>
Aug 26 13:36:15 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:36:15</nova:creationTime>
Aug 26 13:36:15 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:36:15 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:36:15 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:36:15 user nova-compute[73503]:       <nova:owner>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:user uuid="069e5b62e5904df6bef00673c3a83f0d">tempest-TestMinimumBasicScenario-1890777113-project-member</nova:user>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:project uuid="af0839baf2914ad9a087bee16cf3e1b5">tempest-TestMinimumBasicScenario-1890777113</nova:project>
Aug 26 13:36:15 user nova-compute[73503]:       </nova:owner>
Aug 26 13:36:15 user nova-compute[73503]:       <nova:root type="image" uuid="1d7aeddf-84ce-4c03-b40c-629ee10a512e"/>
Aug 26 13:36:15 user nova-compute[73503]:       <nova:ports>
Aug 26 13:36:15 user nova-compute[73503]:         <nova:port uuid="94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f">
Aug 26 13:36:15 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:36:15 user nova-compute[73503]:         </nova:port>
Aug 26 13:36:15 user nova-compute[73503]:       </nova:ports>
Aug 26 13:36:15 user nova-compute[73503]:     </nova:instance>
Aug 26 13:36:15 user nova-compute[73503]:   </metadata>
Aug 26 13:36:15 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:36:15 user nova-compute[73503]:     <system>
Aug 26 13:36:15 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:36:15 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:36:15 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:36:15 user nova-compute[73503]:       <entry name="serial">0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9</entry>
Aug 26 13:36:15 user nova-compute[73503]:       <entry name="uuid">0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9</entry>
Aug 26 13:36:15 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:36:15 user nova-compute[73503]:     </system>
Aug 26 13:36:15 user nova-compute[73503]:   </sysinfo>
Aug 26 13:36:15 user nova-compute[73503]:   <os>
Aug 26 13:36:15 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:36:15 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:36:15 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:36:15 user nova-compute[73503]:   </os>
Aug 26 13:36:15 user nova-compute[73503]:   <features>
Aug 26 13:36:15 user nova-compute[73503]:     <acpi/>
Aug 26 13:36:15 user nova-compute[73503]:     <apic/>
Aug 26 13:36:15 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:36:15 user nova-compute[73503]:   </features>
Aug 26 13:36:15 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:36:15 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:36:15 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:36:15 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:36:15 user nova-compute[73503]:   </clock>
Aug 26 13:36:15 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:36:15 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:36:15 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:36:15 user nova-compute[73503]:   </cpu>
Aug 26 13:36:15 user nova-compute[73503]:   <devices>
Aug 26 13:36:15 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:36:15 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:36:15 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk"/>
Aug 26 13:36:15 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:36:15 user nova-compute[73503]:     </disk>
Aug 26 13:36:15 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:36:15 user nova-compute[73503]:       <mac address="fa:16:3e:51:21:d4"/>
Aug 26 13:36:15 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:36:15 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:36:15 user nova-compute[73503]:       <target dev="tap94b6a75b-9f"/>
Aug 26 13:36:15 user nova-compute[73503]:     </interface>
Aug 26 13:36:15 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:36:15 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/console.log" append="off"/>
Aug 26 13:36:15 user nova-compute[73503]:     </serial>
Aug 26 13:36:15 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:36:15 user nova-compute[73503]:     <video>
Aug 26 13:36:15 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:36:15 user nova-compute[73503]:     </video>
Aug 26 13:36:15 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:36:15 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:36:15 user nova-compute[73503]:     </rng>
Aug 26 13:36:15 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:36:15 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:36:15 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:36:15 user nova-compute[73503]:     </memballoon>
Aug 26 13:36:15 user nova-compute[73503]:   </devices>
Aug 26 13:36:15 user nova-compute[73503]: </domain>
Aug 26 13:36:15 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1717550581',display_name='tempest-TestMinimumBasicScenario-server-1717550581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1717550581',id=46,image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTLRC03UdEqg7pC+RsyF073pr4L5bFbWnL0sREFh8VfjtPojwgSml38ZRVKikdsDbTmuOTLdJMPcvN6R/BRbkL1Uw0qCc6I2ITlaIZNYaMjXJngr/BRCTEVUt8EoJIdPA==',key_name='tempest-TestMinimumBasicScenario-2116688177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-cz260b2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:36:12Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG os_vif [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94b6a75b-9f, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94b6a75b-9f, col_values=(('external_ids', {'iface-id': '94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:21:d4', 'vm-uuid': '0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:15 user nova-compute[73503]: INFO os_vif [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f')
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:36:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No VIF found with MAC fa:16:3e:51:21:d4, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-582d22e7-c151-46ef-87ef-6419f2daf933 req-5b723f4e-009b-4992-a8bb-aab964f20a79 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-582d22e7-c151-46ef-87ef-6419f2daf933 req-5b723f4e-009b-4992-a8bb-aab964f20a79 service nova] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-582d22e7-c151-46ef-87ef-6419f2daf933 req-5b723f4e-009b-4992-a8bb-aab964f20a79 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-582d22e7-c151-46ef-87ef-6419f2daf933 req-5b723f4e-009b-4992-a8bb-aab964f20a79 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-582d22e7-c151-46ef-87ef-6419f2daf933 req-5b723f4e-009b-4992-a8bb-aab964f20a79 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] No waiting events found dispatching network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:17 user nova-compute[73503]: WARNING nova.compute.manager [req-582d22e7-c151-46ef-87ef-6419f2daf933 req-5b723f4e-009b-4992-a8bb-aab964f20a79 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received unexpected event network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 for instance with vm_state building and task_state spawning.
Aug 26 13:36:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG nova.compute.manager [req-d253f5ff-30dc-41b6-b745-b34adb69c216 req-bea2ef41-a99b-4b71-876f-c165f3cd6db3 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d253f5ff-30dc-41b6-b745-b34adb69c216 req-bea2ef41-a99b-4b71-876f-c165f3cd6db3 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d253f5ff-30dc-41b6-b745-b34adb69c216 req-bea2ef41-a99b-4b71-876f-c165f3cd6db3 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d253f5ff-30dc-41b6-b745-b34adb69c216 req-bea2ef41-a99b-4b71-876f-c165f3cd6db3 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG nova.compute.manager [req-d253f5ff-30dc-41b6-b745-b34adb69c216 req-bea2ef41-a99b-4b71-876f-c165f3cd6db3 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:18 user nova-compute[73503]: WARNING nova.compute.manager [req-d253f5ff-30dc-41b6-b745-b34adb69c216 req-bea2ef41-a99b-4b71-876f-c165f3cd6db3 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state building and task_state spawning.
Aug 26 13:36:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-0adbf80c-2ec8-4549-80b2-97aabb8ccaa1 req-d4525217-df85-468a-a331-0468d5e877f3 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0adbf80c-2ec8-4549-80b2-97aabb8ccaa1 req-d4525217-df85-468a-a331-0468d5e877f3 service nova] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0adbf80c-2ec8-4549-80b2-97aabb8ccaa1 req-d4525217-df85-468a-a331-0468d5e877f3 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0adbf80c-2ec8-4549-80b2-97aabb8ccaa1 req-d4525217-df85-468a-a331-0468d5e877f3 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:19 user nova-compute[73503]: DEBUG nova.compute.manager [req-0adbf80c-2ec8-4549-80b2-97aabb8ccaa1 req-d4525217-df85-468a-a331-0468d5e877f3 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] No waiting events found dispatching network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:19 user nova-compute[73503]: WARNING nova.compute.manager [req-0adbf80c-2ec8-4549-80b2-97aabb8ccaa1 req-d4525217-df85-468a-a331-0468d5e877f3 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received unexpected event network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 for instance with vm_state building and task_state spawning.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056980.1502767, 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] VM Resumed (Lifecycle Event)
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Instance spawned successfully.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance spawned successfully.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056980.1542754, dc382e76-a52b-47d7-8772-d795658d9f38 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] VM Resumed (Lifecycle Event)
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056980.1556182, 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] VM Started (Lifecycle Event)
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Took 7.74 seconds to spawn the instance on the hypervisor.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693056980.155954, dc382e76-a52b-47d7-8772-d795658d9f38 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] VM Started (Lifecycle Event)
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-4fe76b2d-10a0-4112-bf31-34bdd78165e9 req-896942b8-023e-4522-bb8b-48de0d6fd34e service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4fe76b2d-10a0-4112-bf31-34bdd78165e9 req-896942b8-023e-4522-bb8b-48de0d6fd34e service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4fe76b2d-10a0-4112-bf31-34bdd78165e9 req-896942b8-023e-4522-bb8b-48de0d6fd34e service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4fe76b2d-10a0-4112-bf31-34bdd78165e9 req-896942b8-023e-4522-bb8b-48de0d6fd34e service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-4fe76b2d-10a0-4112-bf31-34bdd78165e9 req-896942b8-023e-4522-bb8b-48de0d6fd34e service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:20 user nova-compute[73503]: WARNING nova.compute.manager [req-4fe76b2d-10a0-4112-bf31-34bdd78165e9 req-896942b8-023e-4522-bb8b-48de0d6fd34e service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state building and task_state spawning.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Terminating instance
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Took 8.56 seconds to build instance.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:36:20 user nova-compute[73503]: INFO nova.compute.manager [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Took 20.72 seconds to build instance.
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-97e34eb9-9b88-403f-975d-5d4b94b29e0f tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.650s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-59f82950-b3e6-4f81-8560-d9fc4ee3fb3a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dc382e76-a52b-47d7-8772-d795658d9f38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.893s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Instance destroyed successfully.
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'resources' on Instance uuid 6472acd9-81af-48fe-9650-0cfb8146dbd0 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:20:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934835306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934835306',id=22,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:22:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-d0e9400p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:24:20Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=6472acd9-81af-48fe-9650-0cfb8146dbd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "4fc22ec9-afba-413e-9399-378319124489", "address": "fa:16:3e:85:0c:88", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fc22ec9-af", "ovs_interfaceid": "4fc22ec9-afba-413e-9399-378319124489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_vif [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fc22ec9-af, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:36:21 user nova-compute[73503]: INFO os_vif [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:0c:88,bridge_name='br-int',has_traffic_filtering=True,id=4fc22ec9-afba-413e-9399-378319124489,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fc22ec9-af')
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qiKESuzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:36:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e6052-d277-40cc-8efc-6a534a35a16c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eadd12-7921-41f8-bffa-5a888939ec30]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:36:21 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:36:21 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:36:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be (non-flash)
Aug 26 13:36:21 user nova-compute[73503]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:36:21 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:36:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3218f4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553c0b1-2d6b-48bc-9e62-c4b7410c210f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad60d36-f4cf-4a76-9eda-a85ac98d0038]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89885a3f-d6b8-4d53-b218-73f4d916233e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f436b-33a9-4212-9c72-214787e95d0d]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f686e50-f0f7-403b-9b74-b55fab9bcfc9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e79105-948a-430e-8c5c-625e4fad5ceb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260]
Aug 26 13:36:21 user nova-compute[73503]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be, portal: 172.16.0.220,3260] successful.
Aug 26 13:36:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f637674-bc8a-4cf9-9047-5af7b3e4b6be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[927ea60c-7a87-43c6-8b5c-01329f35b7a2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] <== disconnect_volume: return (355ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:36:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Deleting instance files /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0_del
Aug 26 13:36:21 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Deletion of /opt/stack/data/nova/instances/6472acd9-81af-48fe-9650-0cfb8146dbd0_del complete
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:21 user nova-compute[73503]: WARNING nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state active and task_state deleting.
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:21 user nova-compute[73503]: WARNING nova.compute.manager [req-8ff82261-766a-4743-ae87-642c55204ac3 req-a17d6559-f65e-4e8b-8350-6a08616ad4d3 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state active and task_state deleting.
Aug 26 13:36:21 user nova-compute[73503]: INFO nova.compute.manager [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 26 13:36:21 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:36:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:22 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:36:22 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Took 0.88 seconds to deallocate network for instance.
Aug 26 13:36:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:23 user nova-compute[73503]: INFO nova.compute.manager [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Took 0.92 seconds to detach 1 volumes for instance.
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:23 user nova-compute[73503]: WARNING nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state deleted and task_state None.
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:23 user nova-compute[73503]: WARNING nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-unplugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state deleted and task_state None.
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-deleted-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Acquiring lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] No waiting events found dispatching network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:36:23 user nova-compute[73503]: WARNING nova.compute.manager [req-13839127-dd9f-4498-b133-a1fa4e5741f6 req-602c2cc8-13a1-4385-bb84-e32026a2e214 service nova] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Received unexpected event network-vif-plugged-4fc22ec9-afba-413e-9399-378319124489 for instance with vm_state deleted and task_state None.
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:36:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:24 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Deleted allocations for instance 6472acd9-81af-48fe-9650-0cfb8146dbd0
Aug 26 13:36:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-15202f9e-c89b-4f69-b4a5-669495971f3a tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "6472acd9-81af-48fe-9650-0cfb8146dbd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.595s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:36:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:36:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:36:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:36:31 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:36:31 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8011MB free_disk=24.774269104003906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 45a45e79-86a3-40a8-96bc-7437cf769580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dc382e76-a52b-47d7-8772-d795658d9f38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:36:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:36:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:36:36 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693056981.3106117, 6472acd9-81af-48fe-9650-0cfb8146dbd0 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:36:36 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] VM Stopped (Lifecycle Event)
Aug 26 13:36:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-bd1b8739-3768-4704-9f3f-89df429793f9 None None] [instance: 6472acd9-81af-48fe-9650-0cfb8146dbd0] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:36:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:36:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:36:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:37:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:37:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:37:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:37:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-changed-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Refreshing instance network info cache due to event network-changed-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] Acquiring lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] Acquired lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Refreshing network info cache for port b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'flavor' on Instance uuid 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:37:10 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Ignoring supplied device name: /dev/vdb
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:10 user nova-compute[73503]: INFO nova.compute.manager [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Attaching volume b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 to /dev/vdb
Aug 26 13:37:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb4a783-c96c-4f82-abcf-b4ff9867e482]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb39b784-df5a-4534-a326-39075c843a46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e947b1-81d9-4ea1-b6ad-dc3e223ee6d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[90412066-8e35-4bc7-9cd0-fab116ec6a81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:37:10 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:37:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[34425136-6e8c-498b-a7a2-a012e47f45a6]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updating existing volume attachment record: 4df05edd-1757-47b4-aea7-3f15b44a2524 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updated VIF entry in instance network info cache for port b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:37:10 user nova-compute[73503]: DEBUG nova.network.neutron [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updating instance_info_cache with network_info: [{"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8c8327e-c9ec-4273-b9b5-107004df5f30 req-02340ae4-f0e5-45ea-8b25-99e1e933bdc7 service nova] Releasing lock "refresh_cache-7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "45a45e79-86a3-40a8-96bc-7437cf769580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:11 user nova-compute[73503]: INFO nova.compute.manager [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Terminating instance
Aug 26 13:37:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-vif-unplugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] No waiting events found dispatching network-vif-unplugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-vif-unplugged-e3004e08-6b95-40d8-a434-97b177dfe352 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] Acquiring lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] Lock "45a45e79-86a3-40a8-96bc-7437cf769580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] No waiting events found dispatching network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:37:12 user nova-compute[73503]: WARNING nova.compute.manager [req-79ced63a-7a55-4c04-9a81-7f5368d5d492 req-fa2973ae-7c05-47ad-9d34-c210a0287ee0 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received unexpected event network-vif-plugged-e3004e08-6b95-40d8-a434-97b177dfe352 for instance with vm_state active and task_state deleting.
Aug 26 13:37:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Instance destroyed successfully.
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.objects.instance [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lazy-loading 'resources' on Instance uuid 45a45e79-86a3-40a8-96bc-7437cf769580 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1173368871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1173368871',id=18,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b965a76e3c04068b81deca48c6efba6',ramdisk_id='',reservation_id='r-odfd8dm4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:19:30Z,user_data=None,user_id='1a89a1af8a5843ed93bf6f11556e1f65',uuid=45a45e79-86a3-40a8-96bc-7437cf769580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converting VIF {"id": "e3004e08-6b95-40d8-a434-97b177dfe352", "address": "fa:16:3e:cd:62:11", "network": {"id": "00feadfe-490f-46a9-a135-fe046cc705fe", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-442031714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b965a76e3c04068b81deca48c6efba6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3004e08-6b", "ovs_interfaceid": "e3004e08-6b95-40d8-a434-97b177dfe352", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG os_vif [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3004e08-6b, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:12 user nova-compute[73503]: INFO os_vif [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:62:11,bridge_name='br-int',has_traffic_filtering=True,id=e3004e08-6b95-40d8-a434-97b177dfe352,network=Network(00feadfe-490f-46a9-a135-fe046cc705fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3004e08-6b')
Aug 26 13:37:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Deleting instance files /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580_del
Aug 26 13:37:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Deletion of /opt/stack/data/nova/instances/45a45e79-86a3-40a8-96bc-7437cf769580_del complete
Aug 26 13:37:12 user nova-compute[73503]: INFO nova.compute.manager [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 13:37:12 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:37:12 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:13 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Took 0.97 seconds to deallocate network for instance.
Aug 26 13:37:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3fdd66f-4531-4d2c-9716-d749ced61c84 req-1762a44f-bfc2-4e5a-814f-f6beaf0b8585 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Received event network-vif-deleted-e3004e08-6b95-40d8-a434-97b177dfe352 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:13 user nova-compute[73503]: INFO nova.compute.manager [req-e3fdd66f-4531-4d2c-9716-d749ced61c84 req-1762a44f-bfc2-4e5a-814f-f6beaf0b8585 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Neutron deleted interface e3004e08-6b95-40d8-a434-97b177dfe352; detaching it from the instance and deleting it from the info cache
Aug 26 13:37:13 user nova-compute[73503]: DEBUG nova.network.neutron [req-e3fdd66f-4531-4d2c-9716-d749ced61c84 req-1762a44f-bfc2-4e5a-814f-f6beaf0b8585 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3fdd66f-4531-4d2c-9716-d749ced61c84 req-1762a44f-bfc2-4e5a-814f-f6beaf0b8585 service nova] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Detach interface failed, port_id=e3004e08-6b95-40d8-a434-97b177dfe352, reason: Instance 45a45e79-86a3-40a8-96bc-7437cf769580 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:37:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:13 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Deleted allocations for instance 45a45e79-86a3-40a8-96bc-7437cf769580
Aug 26 13:37:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f2c7f6fa-66de-471b-9f7b-e4313194481d tempest-ServerBootFromVolumeStableRescueTest-1652147779 tempest-ServerBootFromVolumeStableRescueTest-1652147779-project-member] Lock "45a45e79-86a3-40a8-96bc-7437cf769580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.451s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:37:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOKtzsQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:37:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:37:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:37:21 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed7b607-2858-4464-89e6-aed8edc34379]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:37:21 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d11082-676c-41f4-9ed5-b93728c73b62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51] added
Aug 26 13:37:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c5eba4-a2ba-4347-9f17-06ed30013036]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d733a13-ed82-425f-9c0f-9861781ed95a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vOKtzsQk {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vOKtzsQk" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c638f2c-6331-43ab-aaea-76c8de0801f4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vOKtzsQk'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[177abcb0-fba8-4505-9efd-3d4a624824c2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c152fbd3-8613-4494-be03-f05b16c449bf]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[706b5e0f-3ec9-4722-887d-d3b5061b914f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260]
Aug 26 13:37:22 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260] successful.
Aug 26 13:37:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d946b669-f3cb-4e0c-a781-268eb881a74a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d60404-bf57-417a-87a7-0832d844a6da]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 (non-flash)
Aug 26 13:37:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99e8764-3dcf-4c3c-9835-28f327c32830]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOKtzsQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:22 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23931356138613366', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931356138613366', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'flavor' on Instance uuid 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:37:23 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:37:23 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:37:23 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:37:23 user nova-compute[73503]:   <serial>b0383f96-d1b5-40bf-bc59-3dc18b3c2c51</serial>
Aug 26 13:37:23 user nova-compute[73503]: </disk>
Aug 26 13:37:23 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] No VIF found with MAC fa:16:3e:52:80:c3, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:37:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1eec1837-3403-4985-8385-3b43ab5251bd tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.256s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:27 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057032.2019622, 45a45e79-86a3-40a8-96bc-7437cf769580 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:37:27 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] VM Stopped (Lifecycle Event)
Aug 26 13:37:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5cb4445e-eb6a-4035-9f46-387ca7807e5b None None] [instance: 45a45e79-86a3-40a8-96bc-7437cf769580] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:37:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:37:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:37:29 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:37:30 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:37:32 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:37:32 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:37:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8181MB free_disk=24.860607147216797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dc382e76-a52b-47d7-8772-d795658d9f38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:37:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:41 user nova-compute[73503]: INFO nova.compute.manager [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Unrescuing
Aug 26 13:37:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'flavor' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-3dd111a2-c9f8-45ed-b987-de2eb1fc9a42 req-c5a084e3-dbb7-40f3-b856-cf84e4bd0d2c service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3dd111a2-c9f8-45ed-b987-de2eb1fc9a42 req-c5a084e3-dbb7-40f3-b856-cf84e4bd0d2c service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3dd111a2-c9f8-45ed-b987-de2eb1fc9a42 req-c5a084e3-dbb7-40f3-b856-cf84e4bd0d2c service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3dd111a2-c9f8-45ed-b987-de2eb1fc9a42 req-c5a084e3-dbb7-40f3-b856-cf84e4bd0d2c service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-3dd111a2-c9f8-45ed-b987-de2eb1fc9a42 req-c5a084e3-dbb7-40f3-b856-cf84e4bd0d2c service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:37:42 user nova-compute[73503]: WARNING nova.compute.manager [req-3dd111a2-c9f8-45ed-b987-de2eb1fc9a42 req-c5a084e3-dbb7-40f3-b856-cf84e4bd0d2c service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance destroyed successfully.
Aug 26 13:37:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing instance network info cache due to event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:37:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updated VIF entry in instance network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG nova.network.neutron [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-dcfb149f-f4b2-45f7-9016-1bd285131b15 req-cc3e7fdc-75ac-4450-ba56-5f31699b0284 service nova] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:37:44 user nova-compute[73503]: WARNING nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:37:44 user nova-compute[73503]: WARNING nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:37:44 user nova-compute[73503]: WARNING nova.compute.manager [req-e2790f7b-c7e0-4b8d-8c42-5c7097fc18c5 req-0a07b108-9574-4630-afb5-a7250c9cdbda service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state rescued and task_state unrescuing.
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing instance network info cache due to event network-changed-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] Acquiring lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] Acquired lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:37:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Refreshing network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:37:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updated VIF entry in instance network info cache for port 9cfd54a1-f3e1-4d51-bb9b-49aeeb786104. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:37:45 user nova-compute[73503]: DEBUG nova.network.neutron [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [{"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6f0ff433-ce70-46a6-a84f-730ecbfb15e5 req-187e0097-b568-4710-99a1-e10ab3aaf1ea service nova] Releasing lock "refresh_cache-794e9828-4b77-4d11-84b8-5505e579949d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 794e9828-4b77-4d11-84b8-5505e579949d due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057066.2447252, 794e9828-4b77-4d11-84b8-5505e579949d => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:37:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Resumed (Lifecycle Event)
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5df378c9-1064-4e0e-b4e1-d625ff215d9a tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:37:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057066.2481287, 794e9828-4b77-4d11-84b8-5505e579949d => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:37:46 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Started (Lifecycle Event)
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:37:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:37:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-changed-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:37:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Refreshing instance network info cache due to event network-changed-238f7459-6018-428d-a558-ed914d839f97. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:37:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] Acquiring lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:37:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] Acquired lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:37:51 user nova-compute[73503]: DEBUG nova.network.neutron [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Refreshing network info cache for port 238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:37:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updated VIF entry in instance network info cache for port 238f7459-6018-428d-a558-ed914d839f97. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:37:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:37:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f5ec031f-d4f0-4111-91d8-9e6b0a3eeb68 req-1b50e81c-766e-489b-acce-e36881bb87fe service nova] Releasing lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:37:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:54 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:37:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:37:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_power_states {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid dc382e76-a52b-47d7-8772-d795658d9f38 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "794e9828-4b77-4d11-84b8-5505e579949d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "dc382e76-a52b-47d7-8772-d795658d9f38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "794e9828-4b77-4d11-84b8-5505e579949d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "dc382e76-a52b-47d7-8772-d795658d9f38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:37:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:02 user nova-compute[73503]: INFO nova.compute.manager [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Detaching volume b0383f96-d1b5-40bf-bc59-3dc18b3c2c51
Aug 26 13:38:03 user nova-compute[73503]: INFO nova.virt.block_device [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Attempting to driver detach volume b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 from mountpoint /dev/vdb
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Attempting to detach device vdb from instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:38:03 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:03 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:38:03 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:38:03 user nova-compute[73503]:   <serial>b0383f96-d1b5-40bf-bc59-3dc18b3c2c51</serial>
Aug 26 13:38:03 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:38:03 user nova-compute[73503]: </disk>
Aug 26 13:38:03 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:38:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully detached device vdb from instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 from the persistent domain config.
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:38:03 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:03 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:38:03 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:38:03 user nova-compute[73503]:   <serial>b0383f96-d1b5-40bf-bc59-3dc18b3c2c51</serial>
Aug 26 13:38:03 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:38:03 user nova-compute[73503]: </disk>
Aug 26 13:38:03 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057083.6640513, 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:38:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully detached device vdb from instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 from the live domain config.
Aug 26 13:38:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOKtzsQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:03 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb55e0f3-961b-47cd-9102-20f873d7139d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f60e7f-e720-4884-922f-26b9db768aa4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:38:03 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:03 user nova-compute[73503]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 (non-flash)
Aug 26 13:38:03 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:38:03 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:03 user nova-compute[73503]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 (non-flash)
Aug 26 13:38:03 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304423e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e4b35d-75cb-4290-a69e-0be94f253375]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b71593-a39c-4cbb-9149-b41ff6cc49c0]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63773851-83ee-4a5d-86f7-ac1f2c29ed82]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[61516125-9613-4295-8d55-89244dce8eb7]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df5c06e-ce30-407c-85dc-2d74459d1870]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a752c83d-49f0-4ce9-a433-448fc322dea7]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260]
Aug 26 13:38:04 user nova-compute[73503]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51, portal: 172.16.0.220,3260] successful.
Aug 26 13:38:04 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79784d-94bf-4027-9440-65fba8bd03da]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== disconnect_volume: return (362ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.objects.instance [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'flavor' on Instance uuid 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-a94f9b90-4ec7-43b0-a67c-44533f002825 tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.239s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.051s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:05 user nova-compute[73503]: INFO nova.compute.manager [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Terminating instance
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-c45e333d-2b40-4056-abd2-e368a4f9b376 req-f78619f2-5e42-450d-aaea-e7582f50476b service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-unplugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c45e333d-2b40-4056-abd2-e368a4f9b376 req-f78619f2-5e42-450d-aaea-e7582f50476b service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c45e333d-2b40-4056-abd2-e368a4f9b376 req-f78619f2-5e42-450d-aaea-e7582f50476b service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c45e333d-2b40-4056-abd2-e368a4f9b376 req-f78619f2-5e42-450d-aaea-e7582f50476b service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-c45e333d-2b40-4056-abd2-e368a4f9b376 req-f78619f2-5e42-450d-aaea-e7582f50476b service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-unplugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-c45e333d-2b40-4056-abd2-e368a4f9b376 req-f78619f2-5e42-450d-aaea-e7582f50476b service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-unplugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Instance destroyed successfully.
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.objects.instance [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lazy-loading 'resources' on Instance uuid 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:35:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-482095829',display_name='tempest-VolumesSnapshotTestJSON-instance-482095829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-482095829',id=44,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGRBy+or9cWSpC+1/RxL1CV/iQcVkHd10kHxK2iHN0LPUkxGQgP7XXopGDeD9jG0IyA9PnFhWn+fQoU5ZdgKneNf2QMwTaIAMvIYmcKm2JWke64t/jNWIMCkQ/S5SIeyg==',key_name='tempest-keypair-1475268475',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:35:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='576be623b4ce46609c0ffee21379fd9d',ramdisk_id='',reservation_id='r-skwbih5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1292919532',owner_user_name='tempest-VolumesSnapshotTestJSON-1292919532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb38c05c97845f2b48b81aa5202945b',uuid=7b7cc387-2147-4cbe-bd1d-e3a5fd593b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converting VIF {"id": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "address": "fa:16:3e:52:80:c3", "network": {"id": "0b0a39ff-c4d3-4748-a76f-8bfb4f282096", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-869250356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "576be623b4ce46609c0ffee21379fd9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ff7ec2-5b", "ovs_interfaceid": "b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG os_vif [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2ff7ec2-5b, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:38:05 user nova-compute[73503]: INFO os_vif [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:80:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd,network=Network(0b0a39ff-c4d3-4748-a76f-8bfb4f282096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ff7ec2-5b')
Aug 26 13:38:05 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vOKtzsQk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:05 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:05 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0383f96-d1b5-40bf-bc59-3dc18b3c2c51', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d30a155-1981-4fda-903f-92b48b8e8fba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d87f0a-92b1-43b3-94b6-e7ca0a07b767]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:38:06 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:38:06 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:06 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304523130>, {}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Disconnecting from: [] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] <== disconnect_volume: return (82ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:38:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Deleting instance files /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05_del
Aug 26 13:38:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Deletion of /opt/stack/data/nova/instances/7b7cc387-2147-4cbe-bd1d-e3a5fd593b05_del complete
Aug 26 13:38:06 user nova-compute[73503]: INFO nova.compute.manager [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 13:38:06 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-cf05cc29-8b04-49a8-841f-5fcd298b3777 req-5e336dc7-896d-4474-b50a-17d269434ef7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-deleted-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:07 user nova-compute[73503]: INFO nova.compute.manager [req-cf05cc29-8b04-49a8-841f-5fcd298b3777 req-5e336dc7-896d-4474-b50a-17d269434ef7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Neutron deleted interface b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd; detaching it from the instance and deleting it from the info cache
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.network.neutron [req-cf05cc29-8b04-49a8-841f-5fcd298b3777 req-5e336dc7-896d-4474-b50a-17d269434ef7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:07 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Took 1.14 seconds to deallocate network for instance.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-cf05cc29-8b04-49a8-841f-5fcd298b3777 req-5e336dc7-896d-4474-b50a-17d269434ef7 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Detach interface failed, port_id=b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd, reason: Instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:38:07 user nova-compute[73503]: WARNING nova.volume.cinder [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Attachment 4df05edd-1757-47b4-aea7-3f15b44a2524 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4df05edd-1757-47b4-aea7-3f15b44a2524. (HTTP 404) (Request-ID: req-8c51197d-2b21-45d3-9a45-3e8023be1d3d)
Aug 26 13:38:07 user nova-compute[73503]: INFO nova.compute.manager [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Took 0.03 seconds to detach 1 volumes for instance.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:07 user nova-compute[73503]: WARNING nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state deleted and task_state None.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:07 user nova-compute[73503]: WARNING nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state deleted and task_state None.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:07 user nova-compute[73503]: WARNING nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state deleted and task_state None.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-unplugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-unplugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:07 user nova-compute[73503]: WARNING nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-unplugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state deleted and task_state None.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Acquiring lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] No waiting events found dispatching network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:07 user nova-compute[73503]: WARNING nova.compute.manager [req-963ac727-f90e-456c-994f-2002088f53d4 req-b72a9c2b-c415-477d-b780-531ddb71bd88 service nova] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Received unexpected event network-vif-plugged-b2ff7ec2-5bf6-41de-ab94-9d7d182dbacd for instance with vm_state deleted and task_state None.
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:07 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Deleted allocations for instance 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05
Aug 26 13:38:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-94a32480-1766-4364-99c7-4cd18e4fe57f tempest-VolumesSnapshotTestJSON-1292919532 tempest-VolumesSnapshotTestJSON-1292919532-project-member] Lock "7b7cc387-2147-4cbe-bd1d-e3a5fd593b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.704s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG nova.objects.instance [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'flavor' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:38:08 user nova-compute[73503]: INFO nova.compute.claims [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Claim successful on node user
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:08 user nova-compute[73503]: INFO nova.compute.manager [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Attaching volume 7c383a53-19b2-45f0-a6f2-03a389236d39 to /dev/vdb
Aug 26 13:38:08 user nova-compute[73503]: DEBUG os_brick.utils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[84acbd47-843c-4cea-81b8-ea37d9635010]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67172f6-3f2a-41c5-926e-d71bb9cb9eea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7985c97b-89eb-45cd-a53c-15a5121ef9bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[482102be-bae2-4d07-9128-7943bffdfd4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:08 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:38:09 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff80568-dc4a-46b8-9e96-21dc785532bb]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.utils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating existing volume attachment record: 9f3abad1-b506-40f7-9cd9-b7244e5563e6 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:38:09 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:38:09 user nova-compute[73503]: INFO nova.virt.block_device [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Booting with volume 64f98258-5c42-4642-a45f-b29c654a202e at /dev/vda
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.policy [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122b92a79d3242f2903b15430240eace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56c42bf18354f55954102eed4da2d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.utils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7084ee0-1d31-4072-a766-e310c1c4fce8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e285bf3-21ec-42e9-88a8-15c89418ed9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9740005-f92f-41b0-bce6-e9f9c841ef9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd94c827-9888-4f1e-9d91-d635ef5b1a80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:38:09 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:38:09 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fb9bd4-c48a-489c-857d-085e84d479fe]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG os_brick.utils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:09 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating existing volume attachment record: 58600b88-efd3-4363-aad3-1157e63a4cca {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:38:10 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Successfully created port: 0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:38:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Successfully updated port: 0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquired lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-changed-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Refreshing instance network info cache due to event network-changed-0692d990-568e-48a2-8081-54adbc1eedb6. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] Acquiring lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating instance_info_cache with network_info: [{"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Releasing lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Instance network_info: |[{"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] Acquired lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Refreshing network info cache for port 0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updated VIF entry in instance network info cache for port 0692d990-568e-48a2-8081-54adbc1eedb6. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG nova.network.neutron [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating instance_info_cache with network_info: [{"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b0667e3e-1b0c-43d4-856b-169285ab05db req-bf8262e1-1cea-4705-b894-20a0e5bf80c8 service nova] Releasing lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:14 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:14 user nova-compute[73503]: INFO nova.compute.manager [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Detaching volume e1197013-2919-406c-9676-65e23bdba133
Aug 26 13:38:15 user nova-compute[73503]: INFO nova.virt.block_device [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Attempting to driver detach volume e1197013-2919-406c-9676-65e23bdba133 from mountpoint /dev/vdb
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Attempting to detach device vdb from instance 794e9828-4b77-4d11-84b8-5505e579949d from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:38:15 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:15 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:38:15 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:38:15 user nova-compute[73503]:   <serial>e1197013-2919-406c-9676-65e23bdba133</serial>
Aug 26 13:38:15 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:38:15 user nova-compute[73503]: </disk>
Aug 26 13:38:15 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:38:15 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Successfully detached device vdb from instance 794e9828-4b77-4d11-84b8-5505e579949d from the persistent domain config.
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 794e9828-4b77-4d11-84b8-5505e579949d from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:38:15 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:15 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:38:15 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:38:15 user nova-compute[73503]:   <serial>e1197013-2919-406c-9676-65e23bdba133</serial>
Aug 26 13:38:15 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:38:15 user nova-compute[73503]: </disk>
Aug 26 13:38:15 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057095.5917077, 794e9828-4b77-4d11-84b8-5505e579949d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:38:15 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Successfully detached device vdb from instance 794e9828-4b77-4d11-84b8-5505e579949d from the live domain config.
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JpWISeTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:15 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[af28f750-bc66-48d5-8f96-2a373c2ff194]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f04b39-f081-4224-b78d-cc17231f61d8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:38:15 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 (non-flash)
Aug 26 13:38:15 user nova-compute[73503]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3044203a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc06b6b-82aa-4014-8a3c-6217d154bbfe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f6eb47-f735-4694-9ce4-2e5ffa6af5d0]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdf9e2e-e6fb-423e-980b-7bb287ef7bc9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de5c32c-e809-42fd-8357-3d31435bdfc2]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c6c73e-f087-4936-a401-163bd7b94f3f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[927136f6-8f25-4ed7-a96b-a06b0edc93b2]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260]
Aug 26 13:38:15 user nova-compute[73503]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133, portal: 172.16.0.220,3260] successful.
Aug 26 13:38:15 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1197013-2919-406c-9676-65e23bdba133 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c6b5d-0d35-4dd5-b046-e1790edd7382]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] <== disconnect_volume: return (310ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:38:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:16 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'flavor' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9fc9bc71-acca-4f5f-9ee5-0286e59cf35d tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.849s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:18 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:18 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:20 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:20 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:20 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb5d33b-a1f6-40bb-a854-568527d2933d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:38:20 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8aa388-08e6-4f4e-997e-76ef8529dcd7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39] added
Aug 26 13:38:20 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7c1d9-61a1-4c00-88bf-3fab44be7815]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc101a4-8ac6-466a-921c-74913e030a53]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoPdMiGV {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057085.9110355, 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:20 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] VM Stopped (Lifecycle Event)
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoPdMiGV" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e1a611-8253-4426-a1ba-157a4962906e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoPdMiGV'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9acfbbac-be53-47ea-a6af-2f8d58504646 None None] [instance: 7b7cc387-2147-4cbe-bd1d-e3a5fd593b05] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a5bb42-15cc-4ae0-b696-c3b9e6c2d692]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[272024ad-a8b1-4fb0-8e24-72f588e8af0f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:20 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:20 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:20 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e28c3c-50a1-426f-b4e8-276553c49123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]
Aug 26 13:38:21 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.
Aug 26 13:38:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6195a9-7868-4a5f-a193-ba4d9543335b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafdd21d-ccd5-47e5-98c7-dafd8d4a42b0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:21 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:21 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8834e7e6-5a76-4dca-8b83-1510f9bcfe10]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:38:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23937313264343333', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313264343333', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'flavor' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:38:22 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:22 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:38:22 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:38:22 user nova-compute[73503]:   <serial>7c383a53-19b2-45f0-a6f2-03a389236d39</serial>
Aug 26 13:38:22 user nova-compute[73503]: </disk>
Aug 26 13:38:22 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No VIF found with MAC fa:16:3e:51:21:d4, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:38:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-773f97b4-9b3d-4680-9b20-0c0b49bb916a tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.944s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:38:23 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Creating image(s)
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Ensure instance console log exists: /opt/stack/data/nova/instances/02c2bc15-18f6-4f54-a447-794ba5ed5cd2/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Start _get_guest_xml network_info=[{"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXiPrypx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02c2bc15-18f6-4f54-a447-794ba5ed5cd2', 'attached_at': '', 'detached_at': '', 'volume_id': '64f98258-5c42-4642-a45f-b29c654a202e', 'serial': '64f98258-5c42-4642-a45f-b29c654a202e'}, 'attachment_id': '58600b88-efd3-4363-aad3-1157e63a4cca', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:38:23 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:23 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXiPrypx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:23 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:23 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:23 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcab31b-c18b-41c4-9520-591b84c89ac5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:38:23 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7618603-6cd5-4e4c-82bb-cdab9ef2e2b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e] added
Aug 26 13:38:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[242ee9ba-9e11-4094-928c-8bc922ec5e82]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[439e8726-2969-40d9-ba47-072b09c50a9c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sXiPrypx {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sXiPrypx" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce2995-af8b-45ad-a952-4b51e9c1e5fa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sXiPrypx'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4943c2-e5bd-443a-81d7-4cbe5474fd6b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6993848-5abf-44d2-a599-85cabd999195]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2ff7a1-c06a-41e2-8713-dcc1f51fa55f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260]
Aug 26 13:38:23 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260] successful.
Aug 26 13:38:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a139a9-3e68-4d1c-933f-fc52ce9fce17]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aae836-6815-48df-a745-2c31972da605]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:23 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:23 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2479ad-7d1f-4a07-8763-ca762665b9df]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:23 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXiPrypx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26366343465376133', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366343465376133', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352508805',display_name='tempest-TestVolumeBootPattern-server-1352508805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352508805',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-sa48ruvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:38:09Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=02c2bc15-18f6-4f54-a447-794ba5ed5cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'pci_devices' on Instance uuid 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:38:24 user nova-compute[73503]:   <uuid>02c2bc15-18f6-4f54-a447-794ba5ed5cd2</uuid>
Aug 26 13:38:24 user nova-compute[73503]:   <name>instance-0000002f</name>
Aug 26 13:38:24 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:38:24 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:38:24 user nova-compute[73503]:   <metadata>
Aug 26 13:38:24 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:38:24 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:38:24 user nova-compute[73503]:       <nova:name>tempest-TestVolumeBootPattern-server-1352508805</nova:name>
Aug 26 13:38:24 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:38:23</nova:creationTime>
Aug 26 13:38:24 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:38:24 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:38:24 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:38:24 user nova-compute[73503]:       <nova:owner>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:user uuid="122b92a79d3242f2903b15430240eace">tempest-TestVolumeBootPattern-813053503-project-member</nova:user>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:project uuid="c56c42bf18354f55954102eed4da2d58">tempest-TestVolumeBootPattern-813053503</nova:project>
Aug 26 13:38:24 user nova-compute[73503]:       </nova:owner>
Aug 26 13:38:24 user nova-compute[73503]:       <nova:ports>
Aug 26 13:38:24 user nova-compute[73503]:         <nova:port uuid="0692d990-568e-48a2-8081-54adbc1eedb6">
Aug 26 13:38:24 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 13:38:24 user nova-compute[73503]:         </nova:port>
Aug 26 13:38:24 user nova-compute[73503]:       </nova:ports>
Aug 26 13:38:24 user nova-compute[73503]:     </nova:instance>
Aug 26 13:38:24 user nova-compute[73503]:   </metadata>
Aug 26 13:38:24 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:38:24 user nova-compute[73503]:     <system>
Aug 26 13:38:24 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:38:24 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:38:24 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:38:24 user nova-compute[73503]:       <entry name="serial">02c2bc15-18f6-4f54-a447-794ba5ed5cd2</entry>
Aug 26 13:38:24 user nova-compute[73503]:       <entry name="uuid">02c2bc15-18f6-4f54-a447-794ba5ed5cd2</entry>
Aug 26 13:38:24 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:38:24 user nova-compute[73503]:     </system>
Aug 26 13:38:24 user nova-compute[73503]:   </sysinfo>
Aug 26 13:38:24 user nova-compute[73503]:   <os>
Aug 26 13:38:24 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:38:24 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:38:24 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:38:24 user nova-compute[73503]:   </os>
Aug 26 13:38:24 user nova-compute[73503]:   <features>
Aug 26 13:38:24 user nova-compute[73503]:     <acpi/>
Aug 26 13:38:24 user nova-compute[73503]:     <apic/>
Aug 26 13:38:24 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:38:24 user nova-compute[73503]:   </features>
Aug 26 13:38:24 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:38:24 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:38:24 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:38:24 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:38:24 user nova-compute[73503]:   </clock>
Aug 26 13:38:24 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:38:24 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:38:24 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:38:24 user nova-compute[73503]:   </cpu>
Aug 26 13:38:24 user nova-compute[73503]:   <devices>
Aug 26 13:38:24 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:38:24 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:24 user nova-compute[73503]:       <source dev="/dev/sdc"/>
Aug 26 13:38:24 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:38:24 user nova-compute[73503]:       <serial>64f98258-5c42-4642-a45f-b29c654a202e</serial>
Aug 26 13:38:24 user nova-compute[73503]:     </disk>
Aug 26 13:38:24 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:38:24 user nova-compute[73503]:       <mac address="fa:16:3e:23:14:46"/>
Aug 26 13:38:24 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:38:24 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:38:24 user nova-compute[73503]:       <target dev="tap0692d990-56"/>
Aug 26 13:38:24 user nova-compute[73503]:     </interface>
Aug 26 13:38:24 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:38:24 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/02c2bc15-18f6-4f54-a447-794ba5ed5cd2/console.log" append="off"/>
Aug 26 13:38:24 user nova-compute[73503]:     </serial>
Aug 26 13:38:24 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:38:24 user nova-compute[73503]:     <video>
Aug 26 13:38:24 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:38:24 user nova-compute[73503]:     </video>
Aug 26 13:38:24 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:38:24 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:38:24 user nova-compute[73503]:     </rng>
Aug 26 13:38:24 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:38:24 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:38:24 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:38:24 user nova-compute[73503]:     </memballoon>
Aug 26 13:38:24 user nova-compute[73503]:   </devices>
Aug 26 13:38:24 user nova-compute[73503]: </domain>
Aug 26 13:38:24 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352508805',display_name='tempest-TestVolumeBootPattern-server-1352508805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352508805',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-sa48ruvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:38:09Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=02c2bc15-18f6-4f54-a447-794ba5ed5cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG os_vif [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0692d990-56, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0692d990-56, col_values=(('external_ids', {'iface-id': '0692d990-568e-48a2-8081-54adbc1eedb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:14:46', 'vm-uuid': '02c2bc15-18f6-4f54-a447-794ba5ed5cd2'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:24 user nova-compute[73503]: INFO os_vif [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56')
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:38:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] No VIF found with MAC fa:16:3e:23:14:46, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:38:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8ec3b01-1c57-4d05-8a49-8358d0400555 req-e88528ad-0486-48fa-bf2c-bb020cbf9bb8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8ec3b01-1c57-4d05-8a49-8358d0400555 req-e88528ad-0486-48fa-bf2c-bb020cbf9bb8 service nova] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8ec3b01-1c57-4d05-8a49-8358d0400555 req-e88528ad-0486-48fa-bf2c-bb020cbf9bb8 service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e8ec3b01-1c57-4d05-8a49-8358d0400555 req-e88528ad-0486-48fa-bf2c-bb020cbf9bb8 service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-e8ec3b01-1c57-4d05-8a49-8358d0400555 req-e88528ad-0486-48fa-bf2c-bb020cbf9bb8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] No waiting events found dispatching network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:27 user nova-compute[73503]: WARNING nova.compute.manager [req-e8ec3b01-1c57-4d05-8a49-8358d0400555 req-e88528ad-0486-48fa-bf2c-bb020cbf9bb8 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received unexpected event network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 for instance with vm_state building and task_state spawning.
Aug 26 13:38:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057108.3334527, 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] VM Resumed (Lifecycle Event)
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Instance spawned successfully.
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057108.3348277, 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] VM Started (Lifecycle Event)
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 26 13:38:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:28 user nova-compute[73503]: INFO nova.compute.manager [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Took 19.87 seconds to build instance.
Aug 26 13:38:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0f0f3324-a56b-46ca-8499-4c7130633964 tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.991s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-c60a4084-0699-4e47-9855-412d2b4a85f5 req-4b275361-de77-466b-abd3-4107326be25d service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c60a4084-0699-4e47-9855-412d2b4a85f5 req-4b275361-de77-466b-abd3-4107326be25d service nova] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c60a4084-0699-4e47-9855-412d2b4a85f5 req-4b275361-de77-466b-abd3-4107326be25d service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c60a4084-0699-4e47-9855-412d2b4a85f5 req-4b275361-de77-466b-abd3-4107326be25d service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG nova.compute.manager [req-c60a4084-0699-4e47-9855-412d2b4a85f5 req-4b275361-de77-466b-abd3-4107326be25d service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] No waiting events found dispatching network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:29 user nova-compute[73503]: WARNING nova.compute.manager [req-c60a4084-0699-4e47-9855-412d2b4a85f5 req-4b275361-de77-466b-abd3-4107326be25d service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received unexpected event network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 for instance with vm_state active and task_state None.
Aug 26 13:38:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:29 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:38:30 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:30 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:30 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:38:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:38:32 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:34 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:34 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8270MB free_disk=24.875537872314453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 794e9828-4b77-4d11-84b8-5505e579949d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dc382e76-a52b-47d7-8772-d795658d9f38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:34 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:38:34 user nova-compute[73503]: INFO nova.compute.claims [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Claim successful on node user
Aug 26 13:38:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:38:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:38:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Creating image(s)
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "/opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "/opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "/opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG nova.policy [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '082caf1398334eafb04a0c56edf0f9f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3af3a7fd8cce4d93af5e44e69d99812b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk 1073741824" returned: 0 in 0.053s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing instance network info cache due to event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Cannot resize image /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Ensure instance console log exists: /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Successfully created port: 4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updated VIF entry in instance network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4d20a61e-d1e5-4819-bfcb-3391921866de req-ddfd3aea-bdc6-4fd4-bad1-7cf07fbf8aed service nova] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Successfully updated port: 4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:38:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquired lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:38:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-changed-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Refreshing instance network info cache due to event network-changed-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] Acquiring lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating instance_info_cache with network_info: [{"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Releasing lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Instance network_info: |[{"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] Acquired lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Refreshing network info cache for port 4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Start _get_guest_xml network_info=[{"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:38:38 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:38 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1814889200',display_name='tempest-TestServerVolumeAttachmentScenario-server-1814889200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1814889200',id=48,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyaethgXB/D1QMmLQDYarTHPC8EyL70wokGFWuChnIFcYLrHQOXOnzWXxYZf2nEaS2cwSkvbaaWkIX2oVRlPaV4Xr8XayIc1e326/wrebxJEGd0lrb4kGsYZi2mGE/myg==',key_name='tempest-keypair-618410501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af3a7fd8cce4d93af5e44e69d99812b',ramdisk_id='',reservation_id='r-ajqkgnk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1086030976',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1086030976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='082caf1398334eafb04a0c56edf0f9f7',uuid=bfbea0ed-730a-4477-9f87-a9b408c9485d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Converting VIF {"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'pci_devices' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:38:38 user nova-compute[73503]:   <uuid>bfbea0ed-730a-4477-9f87-a9b408c9485d</uuid>
Aug 26 13:38:38 user nova-compute[73503]:   <name>instance-00000030</name>
Aug 26 13:38:38 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:38:38 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:38:38 user nova-compute[73503]:   <metadata>
Aug 26 13:38:38 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:38:38 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:38:38 user nova-compute[73503]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1814889200</nova:name>
Aug 26 13:38:38 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:38:38</nova:creationTime>
Aug 26 13:38:38 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:38:38 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:38:38 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:38:38 user nova-compute[73503]:       <nova:owner>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:user uuid="082caf1398334eafb04a0c56edf0f9f7">tempest-TestServerVolumeAttachmentScenario-1086030976-project-member</nova:user>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:project uuid="3af3a7fd8cce4d93af5e44e69d99812b">tempest-TestServerVolumeAttachmentScenario-1086030976</nova:project>
Aug 26 13:38:38 user nova-compute[73503]:       </nova:owner>
Aug 26 13:38:38 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:38:38 user nova-compute[73503]:       <nova:ports>
Aug 26 13:38:38 user nova-compute[73503]:         <nova:port uuid="4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d">
Aug 26 13:38:38 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 13:38:38 user nova-compute[73503]:         </nova:port>
Aug 26 13:38:38 user nova-compute[73503]:       </nova:ports>
Aug 26 13:38:38 user nova-compute[73503]:     </nova:instance>
Aug 26 13:38:38 user nova-compute[73503]:   </metadata>
Aug 26 13:38:38 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:38:38 user nova-compute[73503]:     <system>
Aug 26 13:38:38 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:38:38 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:38:38 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:38:38 user nova-compute[73503]:       <entry name="serial">bfbea0ed-730a-4477-9f87-a9b408c9485d</entry>
Aug 26 13:38:38 user nova-compute[73503]:       <entry name="uuid">bfbea0ed-730a-4477-9f87-a9b408c9485d</entry>
Aug 26 13:38:38 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:38:38 user nova-compute[73503]:     </system>
Aug 26 13:38:38 user nova-compute[73503]:   </sysinfo>
Aug 26 13:38:38 user nova-compute[73503]:   <os>
Aug 26 13:38:38 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:38:38 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:38:38 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:38:38 user nova-compute[73503]:   </os>
Aug 26 13:38:38 user nova-compute[73503]:   <features>
Aug 26 13:38:38 user nova-compute[73503]:     <acpi/>
Aug 26 13:38:38 user nova-compute[73503]:     <apic/>
Aug 26 13:38:38 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:38:38 user nova-compute[73503]:   </features>
Aug 26 13:38:38 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:38:38 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:38:38 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:38:38 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:38:38 user nova-compute[73503]:   </clock>
Aug 26 13:38:38 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:38:38 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:38:38 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:38:38 user nova-compute[73503]:   </cpu>
Aug 26 13:38:38 user nova-compute[73503]:   <devices>
Aug 26 13:38:38 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:38:38 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:38:38 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk"/>
Aug 26 13:38:38 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:38:38 user nova-compute[73503]:     </disk>
Aug 26 13:38:38 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:38:38 user nova-compute[73503]:       <mac address="fa:16:3e:c3:2d:26"/>
Aug 26 13:38:38 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:38:38 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:38:38 user nova-compute[73503]:       <target dev="tap4ed3ad7a-64"/>
Aug 26 13:38:38 user nova-compute[73503]:     </interface>
Aug 26 13:38:38 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:38:38 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/console.log" append="off"/>
Aug 26 13:38:38 user nova-compute[73503]:     </serial>
Aug 26 13:38:38 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:38:38 user nova-compute[73503]:     <video>
Aug 26 13:38:38 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:38:38 user nova-compute[73503]:     </video>
Aug 26 13:38:38 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:38:38 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:38:38 user nova-compute[73503]:     </rng>
Aug 26 13:38:38 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:38:38 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:38:38 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:38:38 user nova-compute[73503]:     </memballoon>
Aug 26 13:38:38 user nova-compute[73503]:   </devices>
Aug 26 13:38:38 user nova-compute[73503]: </domain>
Aug 26 13:38:38 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1814889200',display_name='tempest-TestServerVolumeAttachmentScenario-server-1814889200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1814889200',id=48,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyaethgXB/D1QMmLQDYarTHPC8EyL70wokGFWuChnIFcYLrHQOXOnzWXxYZf2nEaS2cwSkvbaaWkIX2oVRlPaV4Xr8XayIc1e326/wrebxJEGd0lrb4kGsYZi2mGE/myg==',key_name='tempest-keypair-618410501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3af3a7fd8cce4d93af5e44e69d99812b',ramdisk_id='',reservation_id='r-ajqkgnk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1086030976',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1086030976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='082caf1398334eafb04a0c56edf0f9f7',uuid=bfbea0ed-730a-4477-9f87-a9b408c9485d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Converting VIF {"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG os_vif [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed3ad7a-64, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ed3ad7a-64, col_values=(('external_ids', {'iface-id': '4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:2d:26', 'vm-uuid': 'bfbea0ed-730a-4477-9f87-a9b408c9485d'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:38 user nova-compute[73503]: INFO os_vif [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64')
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No VIF found with MAC fa:16:3e:c3:2d:26, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updated VIF entry in instance network info cache for port 4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating instance_info_cache with network_info: [{"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-490f4fff-a0dd-4880-af18-fc648b5b8a52 req-1b9a6653-e143-448c-b21e-f8ee9a9a4848 service nova] Releasing lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-29da7803-75e6-4951-ab94-76698467cedc req-82d194a6-bc26-4609-99fa-47e8f1067ddb service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29da7803-75e6-4951-ab94-76698467cedc req-82d194a6-bc26-4609-99fa-47e8f1067ddb service nova] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29da7803-75e6-4951-ab94-76698467cedc req-82d194a6-bc26-4609-99fa-47e8f1067ddb service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29da7803-75e6-4951-ab94-76698467cedc req-82d194a6-bc26-4609-99fa-47e8f1067ddb service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-29da7803-75e6-4951-ab94-76698467cedc req-82d194a6-bc26-4609-99fa-47e8f1067ddb service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] No waiting events found dispatching network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:40 user nova-compute[73503]: WARNING nova.compute.manager [req-29da7803-75e6-4951-ab94-76698467cedc req-82d194a6-bc26-4609-99fa-47e8f1067ddb service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received unexpected event network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d for instance with vm_state building and task_state spawning.
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing instance network info cache due to event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updated VIF entry in instance network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8614e9a0-558b-4784-91f1-44e075c1f83e req-bd899c0d-5f2c-4595-9d2f-ca94e6088a2d service nova] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057122.051661, bfbea0ed-730a-4477-9f87-a9b408c9485d => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] VM Resumed (Lifecycle Event)
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Instance spawned successfully.
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-e5c76dfb-2871-4e4f-b93a-8f617613517d req-ea126c87-2ed3-4322-8c89-1567a428ac43 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e5c76dfb-2871-4e4f-b93a-8f617613517d req-ea126c87-2ed3-4322-8c89-1567a428ac43 service nova] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e5c76dfb-2871-4e4f-b93a-8f617613517d req-ea126c87-2ed3-4322-8c89-1567a428ac43 service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e5c76dfb-2871-4e4f-b93a-8f617613517d req-ea126c87-2ed3-4322-8c89-1567a428ac43 service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [req-e5c76dfb-2871-4e4f-b93a-8f617613517d req-ea126c87-2ed3-4322-8c89-1567a428ac43 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] No waiting events found dispatching network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:42 user nova-compute[73503]: WARNING nova.compute.manager [req-e5c76dfb-2871-4e4f-b93a-8f617613517d req-ea126c87-2ed3-4322-8c89-1567a428ac43 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received unexpected event network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d for instance with vm_state building and task_state spawning.
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057122.0535266, bfbea0ed-730a-4477-9f87-a9b408c9485d => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] VM Started (Lifecycle Event)
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 26 13:38:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:38:42 user nova-compute[73503]: INFO nova.compute.manager [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Took 7.48 seconds to build instance.
Aug 26 13:38:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d08bca87-7ac2-45de-96e4-a007024f706b tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.574s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:46 user nova-compute[73503]: INFO nova.compute.manager [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Rebooting instance
Aug 26 13:38:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:38:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:38:46 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:38:46 user nova-compute[73503]: DEBUG nova.network.neutron [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-e7223c87-4b58-464a-8ce2-fc2d32588e9e req-d19fbe4a-1183-4714-a8d5-b49e5c160f51 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-unplugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e7223c87-4b58-464a-8ce2-fc2d32588e9e req-d19fbe4a-1183-4714-a8d5-b49e5c160f51 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e7223c87-4b58-464a-8ce2-fc2d32588e9e req-d19fbe4a-1183-4714-a8d5-b49e5c160f51 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e7223c87-4b58-464a-8ce2-fc2d32588e9e req-d19fbe4a-1183-4714-a8d5-b49e5c160f51 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-e7223c87-4b58-464a-8ce2-fc2d32588e9e req-d19fbe4a-1183-4714-a8d5-b49e5c160f51 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-unplugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:47 user nova-compute[73503]: WARNING nova.compute.manager [req-e7223c87-4b58-464a-8ce2-fc2d32588e9e req-d19fbe4a-1183-4714-a8d5-b49e5c160f51 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-unplugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 13:38:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance destroyed successfully.
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'resources' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1717550581',display_name='tempest-TestMinimumBasicScenario-server-1717550581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1717550581',id=46,image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTLRC03UdEqg7pC+RsyF073pr4L5bFbWnL0sREFh8VfjtPojwgSml38ZRVKikdsDbTmuOTLdJMPcvN6R/BRbkL1Uw0qCc6I2ITlaIZNYaMjXJngr/BRCTEVUt8EoJIdPA==',key_name='tempest-TestMinimumBasicScenario-2116688177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-cz260b2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:38:47Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94b6a75b-9f, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:38:48 user nova-compute[73503]: INFO os_vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f')
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:48 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd48fdd-265a-4e0d-b39e-5d02b75299cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6d252-ad3f-4d28-ae41-0e1be3ecceb8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30425ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ac0f7-bc68-43a5-8b57-37e7f487d596]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c252786b-7749-471c-980b-726a00b8ca95]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e03af6-a693-4b6f-88da-0d6b08af7afc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c755e665-449b-4ab4-adb4-81c7530b32ef]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7281c340-edca-43c1-9be1-eb7436171364]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23bf34d-9a2f-4564-b8a1-aa6c314ddfe1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]
Aug 26 13:38:48 user nova-compute[73503]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5bb63-61bf-4fcc-90ba-591cad906a4d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== disconnect_volume: return (312ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Start _get_guest_xml network_info=[{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1d7aeddf-84ce-4c03-b40c-629ee10a512e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '1d7aeddf-84ce-4c03-b40c-629ee10a512e'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9', 'attached_at': '', 'detached_at': '', 'volume_id': '7c383a53-19b2-45f0-a6f2-03a389236d39', 'serial': '7c383a53-19b2-45f0-a6f2-03a389236d39'}, 'attachment_id': '9f3abad1-b506-40f7-9cd9-b7244e5563e6', 'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:38:48 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:48 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1d7aeddf-84ce-4c03-b40c-629ee10a512e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.objects.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Object Instance<0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9> lazy-loaded attributes: resources,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:38:48 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:48 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:38:48 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0498ad77-0877-4718-85ee-71e382a4ef18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:38:48 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f9148b-0a9b-42d8-a807-21a3ba33d7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39] added
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[920c6863-7f59-42f3-97b6-14384bcf9255]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c299c35-8f11-45e3-ada2-a055612c1f46]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoPdMiGV {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoPdMiGV" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4dcbb0-7dd9-435d-a605-f092ca33be78]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoPdMiGV'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0ef546-2f04-4d6a-86fd-c31aeba1882b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7118a-e266-4f8b-9caa-13b73421eab4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a1441-27ff-4d4a-94b4-640524aebee7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]
Aug 26 13:38:48 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf3d92-b175-4c5b-afa3-84405661ff38]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa23cd-2079-47b7-a19c-c97cbe39b795]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:38:48 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:38:48 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f6748-1018-4d15-842f-c65890f559c9]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:38:48 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-bf7ee2dd-d6fc-4678-9409-fbb828205946 req-fb41c1c9-a5a5-4404-8d99-5b3b0e5d28b9 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bf7ee2dd-d6fc-4678-9409-fbb828205946 req-fb41c1c9-a5a5-4404-8d99-5b3b0e5d28b9 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bf7ee2dd-d6fc-4678-9409-fbb828205946 req-fb41c1c9-a5a5-4404-8d99-5b3b0e5d28b9 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-bf7ee2dd-d6fc-4678-9409-fbb828205946 req-fb41c1c9-a5a5-4404-8d99-5b3b0e5d28b9 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-bf7ee2dd-d6fc-4678-9409-fbb828205946 req-fb41c1c9-a5a5-4404-8d99-5b3b0e5d28b9 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:49 user nova-compute[73503]: WARNING nova.compute.manager [req-bf7ee2dd-d6fc-4678-9409-fbb828205946 req-fb41c1c9-a5a5-4404-8d99-5b3b0e5d28b9 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 13:38:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23937313264343333', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313264343333', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1717550581',display_name='tempest-TestMinimumBasicScenario-server-1717550581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1717550581',id=46,image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTLRC03UdEqg7pC+RsyF073pr4L5bFbWnL0sREFh8VfjtPojwgSml38ZRVKikdsDbTmuOTLdJMPcvN6R/BRbkL1Uw0qCc6I2ITlaIZNYaMjXJngr/BRCTEVUt8EoJIdPA==',key_name='tempest-TestMinimumBasicScenario-2116688177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-cz260b2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:38:47Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.objects.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Object Instance<0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:38:49 user nova-compute[73503]:   <uuid>0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9</uuid>
Aug 26 13:38:49 user nova-compute[73503]:   <name>instance-0000002e</name>
Aug 26 13:38:49 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:38:49 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:38:49 user nova-compute[73503]:   <metadata>
Aug 26 13:38:49 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:38:49 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:38:49 user nova-compute[73503]:       <nova:name>tempest-TestMinimumBasicScenario-server-1717550581</nova:name>
Aug 26 13:38:49 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:38:48</nova:creationTime>
Aug 26 13:38:49 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:38:49 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:38:49 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:38:49 user nova-compute[73503]:       <nova:owner>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:user uuid="069e5b62e5904df6bef00673c3a83f0d">tempest-TestMinimumBasicScenario-1890777113-project-member</nova:user>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:project uuid="af0839baf2914ad9a087bee16cf3e1b5">tempest-TestMinimumBasicScenario-1890777113</nova:project>
Aug 26 13:38:49 user nova-compute[73503]:       </nova:owner>
Aug 26 13:38:49 user nova-compute[73503]:       <nova:root type="image" uuid="1d7aeddf-84ce-4c03-b40c-629ee10a512e"/>
Aug 26 13:38:49 user nova-compute[73503]:       <nova:ports>
Aug 26 13:38:49 user nova-compute[73503]:         <nova:port uuid="94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f">
Aug 26 13:38:49 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:38:49 user nova-compute[73503]:         </nova:port>
Aug 26 13:38:49 user nova-compute[73503]:       </nova:ports>
Aug 26 13:38:49 user nova-compute[73503]:     </nova:instance>
Aug 26 13:38:49 user nova-compute[73503]:   </metadata>
Aug 26 13:38:49 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:38:49 user nova-compute[73503]:     <system>
Aug 26 13:38:49 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:38:49 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:38:49 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:38:49 user nova-compute[73503]:       <entry name="serial">0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9</entry>
Aug 26 13:38:49 user nova-compute[73503]:       <entry name="uuid">0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9</entry>
Aug 26 13:38:49 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:38:49 user nova-compute[73503]:     </system>
Aug 26 13:38:49 user nova-compute[73503]:   </sysinfo>
Aug 26 13:38:49 user nova-compute[73503]:   <os>
Aug 26 13:38:49 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:38:49 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:38:49 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:38:49 user nova-compute[73503]:   </os>
Aug 26 13:38:49 user nova-compute[73503]:   <features>
Aug 26 13:38:49 user nova-compute[73503]:     <acpi/>
Aug 26 13:38:49 user nova-compute[73503]:     <apic/>
Aug 26 13:38:49 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:38:49 user nova-compute[73503]:   </features>
Aug 26 13:38:49 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:38:49 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:38:49 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:38:49 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:38:49 user nova-compute[73503]:   </clock>
Aug 26 13:38:49 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:38:49 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:38:49 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:38:49 user nova-compute[73503]:   </cpu>
Aug 26 13:38:49 user nova-compute[73503]:   <devices>
Aug 26 13:38:49 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:38:49 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:38:49 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk"/>
Aug 26 13:38:49 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:38:49 user nova-compute[73503]:     </disk>
Aug 26 13:38:49 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:38:49 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:38:49 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:38:49 user nova-compute[73503]:       <target dev="vdb" bus="virtio"/>
Aug 26 13:38:49 user nova-compute[73503]:       <serial>7c383a53-19b2-45f0-a6f2-03a389236d39</serial>
Aug 26 13:38:49 user nova-compute[73503]:     </disk>
Aug 26 13:38:49 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:38:49 user nova-compute[73503]:       <mac address="fa:16:3e:51:21:d4"/>
Aug 26 13:38:49 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:38:49 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:38:49 user nova-compute[73503]:       <target dev="tap94b6a75b-9f"/>
Aug 26 13:38:49 user nova-compute[73503]:     </interface>
Aug 26 13:38:49 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:38:49 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/console.log" append="off"/>
Aug 26 13:38:49 user nova-compute[73503]:     </serial>
Aug 26 13:38:49 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:38:49 user nova-compute[73503]:     <video>
Aug 26 13:38:49 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:38:49 user nova-compute[73503]:     </video>
Aug 26 13:38:49 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:38:49 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:38:49 user nova-compute[73503]:     </rng>
Aug 26 13:38:49 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:38:49 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:38:49 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:38:49 user nova-compute[73503]:     </memballoon>
Aug 26 13:38:49 user nova-compute[73503]:   </devices>
Aug 26 13:38:49 user nova-compute[73503]: </domain>
Aug 26 13:38:49 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Object Instance<0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Cannot resize image /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'migration_context' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.objects.base [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Object Instance<0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1717550581',display_name='tempest-TestMinimumBasicScenario-server-1717550581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1717550581',id=46,image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTLRC03UdEqg7pC+RsyF073pr4L5bFbWnL0sREFh8VfjtPojwgSml38ZRVKikdsDbTmuOTLdJMPcvN6R/BRbkL1Uw0qCc6I2ITlaIZNYaMjXJngr/BRCTEVUt8EoJIdPA==',key_name='tempest-TestMinimumBasicScenario-2116688177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-cz260b2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:38:47Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG os_vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94b6a75b-9f, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94b6a75b-9f, col_values=(('external_ids', {'iface-id': '94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:21:d4', 'vm-uuid': '0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:38:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:50 user nova-compute[73503]: INFO os_vif [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f')
Aug 26 13:38:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-34905e55-1b9b-4bc6-8314-4e8ba4b7abcb req-cfa485e7-1584-4dfa-b404-6472669b8149 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-34905e55-1b9b-4bc6-8314-4e8ba4b7abcb req-cfa485e7-1584-4dfa-b404-6472669b8149 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-34905e55-1b9b-4bc6-8314-4e8ba4b7abcb req-cfa485e7-1584-4dfa-b404-6472669b8149 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-34905e55-1b9b-4bc6-8314-4e8ba4b7abcb req-cfa485e7-1584-4dfa-b404-6472669b8149 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG nova.compute.manager [req-34905e55-1b9b-4bc6-8314-4e8ba4b7abcb req-cfa485e7-1584-4dfa-b404-6472669b8149 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:52 user nova-compute[73503]: WARNING nova.compute.manager [req-34905e55-1b9b-4bc6-8314-4e8ba4b7abcb req-cfa485e7-1584-4dfa-b404-6472669b8149 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 13:38:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057134.1555295, 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:54 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] VM Resumed (Lifecycle Event)
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:38:54 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance rebooted successfully.
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:38:54 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057134.1571977, 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:38:54 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] VM Started (Lifecycle Event)
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5e4bc1a5-e557-4333-baf3-44d83935fedf tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.182s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [req-004e2599-813c-4be9-8082-f733616442a6 req-bf8b1765-1234-413c-b04a-288a71125672 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-004e2599-813c-4be9-8082-f733616442a6 req-bf8b1765-1234-413c-b04a-288a71125672 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-004e2599-813c-4be9-8082-f733616442a6 req-bf8b1765-1234-413c-b04a-288a71125672 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-004e2599-813c-4be9-8082-f733616442a6 req-bf8b1765-1234-413c-b04a-288a71125672 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:38:54 user nova-compute[73503]: DEBUG nova.compute.manager [req-004e2599-813c-4be9-8082-f733616442a6 req-bf8b1765-1234-413c-b04a-288a71125672 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:38:54 user nova-compute[73503]: WARNING nova.compute.manager [req-004e2599-813c-4be9-8082-f733616442a6 req-bf8b1765-1234-413c-b04a-288a71125672 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state active and task_state None.
Aug 26 13:38:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:38:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:05 user nova-compute[73503]: INFO nova.compute.manager [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Terminating instance
Aug 26 13:39:05 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-88c7a54a-3da5-449c-b4bf-6ddc11084882 req-2d58d656-230c-4aa6-bfa8-b2c67db85db9 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-88c7a54a-3da5-449c-b4bf-6ddc11084882 req-2d58d656-230c-4aa6-bfa8-b2c67db85db9 service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-88c7a54a-3da5-449c-b4bf-6ddc11084882 req-2d58d656-230c-4aa6-bfa8-b2c67db85db9 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-88c7a54a-3da5-449c-b4bf-6ddc11084882 req-2d58d656-230c-4aa6-bfa8-b2c67db85db9 service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-88c7a54a-3da5-449c-b4bf-6ddc11084882 req-2d58d656-230c-4aa6-bfa8-b2c67db85db9 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-88c7a54a-3da5-449c-b4bf-6ddc11084882 req-2d58d656-230c-4aa6-bfa8-b2c67db85db9 service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-unplugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Instance destroyed successfully.
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.objects.instance [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lazy-loading 'resources' on Instance uuid 794e9828-4b77-4d11-84b8-5505e579949d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1286434629',display_name='tempest-ServerStableDeviceRescueTest-server-1286434629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1286434629',id=40,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO803v1ZnwGe07xuV97cGCa9PZQCHx8RnV8gWXHlFNzM6uT8JHsm0zj+rIlavQw4S5XCYFW4ZCIJ+8VEc/rW4EuidFxQS5ce2QH+tYKM68vrGW/bRUa5SRm5/UsjCHiwQg==',key_name='tempest-keypair-442917711',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:35:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c67b91da188457c8798f0a88c03590c',ramdisk_id='',reservation_id='r-yffjwf3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-903706850',owner_user_name='tempest-ServerStableDeviceRescueTest-903706850-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1c5d31dff424c929cd66ba7f031d889',uuid=794e9828-4b77-4d11-84b8-5505e579949d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converting VIF {"id": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "address": "fa:16:3e:04:ff:20", "network": {"id": "8420de9e-22a5-4741-824d-13087dab14aa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1804879398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c67b91da188457c8798f0a88c03590c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cfd54a1-f3", "ovs_interfaceid": "9cfd54a1-f3e1-4d51-bb9b-49aeeb786104", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG os_vif [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cfd54a1-f3, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:39:06 user nova-compute[73503]: INFO os_vif [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=9cfd54a1-f3e1-4d51-bb9b-49aeeb786104,network=Network(8420de9e-22a5-4741-824d-13087dab14aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cfd54a1-f3')
Aug 26 13:39:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Deleting instance files /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d_del
Aug 26 13:39:06 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Deletion of /opt/stack/data/nova/instances/794e9828-4b77-4d11-84b8-5505e579949d_del complete
Aug 26 13:39:06 user nova-compute[73503]: INFO nova.compute.manager [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 13:39:06 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:39:06 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:39:07 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:39:07 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Took 0.89 seconds to deallocate network for instance.
Aug 26 13:39:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:07 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:39:07 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:39:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:07 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Deleted allocations for instance 794e9828-4b77-4d11-84b8-5505e579949d
Aug 26 13:39:07 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f3a2e317-f271-4e91-945a-1410a329b554 tempest-ServerStableDeviceRescueTest-903706850 tempest-ServerStableDeviceRescueTest-903706850-project-member] Lock "794e9828-4b77-4d11-84b8-5505e579949d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:39:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] Acquiring lock "794e9828-4b77-4d11-84b8-5505e579949d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] Lock "794e9828-4b77-4d11-84b8-5505e579949d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] No waiting events found dispatching network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:39:08 user nova-compute[73503]: WARNING nova.compute.manager [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received unexpected event network-vif-plugged-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 for instance with vm_state deleted and task_state None.
Aug 26 13:39:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-7e637a13-2503-48dd-87ae-4d0bf5667610 req-b4fdbe9a-594a-4a91-85ff-f9f53514370e service nova] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Received event network-vif-deleted-9cfd54a1-f3e1-4d51-bb9b-49aeeb786104 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:39:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:39:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:21 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057146.3043153, 794e9828-4b77-4d11-84b8-5505e579949d => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:39:21 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] VM Stopped (Lifecycle Event)
Aug 26 13:39:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-a39908f2-2535-46ce-ba5b-6d7d62d47563 None None] [instance: 794e9828-4b77-4d11-84b8-5505e579949d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:39:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:39:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:39:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:39:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:39:31 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:39:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:39:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:39:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:39:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:39:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:39:36 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:39:36 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8155MB free_disk=24.96835708618164GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dc382e76-a52b-47d7-8772-d795658d9f38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bfbea0ed-730a-4477-9f87-a9b408c9485d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:39:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:39:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:51 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:39:56 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:40:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:40:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:40:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:40:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:40:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-changed-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Refreshing instance network info cache due to event network-changed-0692d990-568e-48a2-8081-54adbc1eedb6. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] Acquiring lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] Acquired lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Refreshing network info cache for port 0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updated VIF entry in instance network info cache for port 0692d990-568e-48a2-8081-54adbc1eedb6. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG nova.network.neutron [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating instance_info_cache with network_info: [{"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-894b8d2c-aa5b-437e-ae72-3d9aeae218fd req-9f343ee9-c8a9-4b7b-8139-56af2dc4ec28 service nova] Releasing lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-changed-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Refreshing instance network info cache due to event network-changed-0692d990-568e-48a2-8081-54adbc1eedb6. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] Acquiring lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] Acquired lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG nova.network.neutron [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Refreshing network info cache for port 0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:03 user nova-compute[73503]: INFO nova.compute.manager [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Terminating instance
Aug 26 13:40:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updated VIF entry in instance network info cache for port 0692d990-568e-48a2-8081-54adbc1eedb6. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating instance_info_cache with network_info: [{"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-13b14a72-2a49-4bf0-9fd9-a5078bdfbd42 req-38187b1e-6344-41de-88ac-edcb16c5dc37 service nova] Releasing lock "refresh_cache-02c2bc15-18f6-4f54-a447-794ba5ed5cd2" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-64168f14-a6d0-4816-a92c-f369fe2564a6 req-8465c82f-8df9-4ebe-a59f-2388bf3dd035 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-vif-unplugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64168f14-a6d0-4816-a92c-f369fe2564a6 req-8465c82f-8df9-4ebe-a59f-2388bf3dd035 service nova] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64168f14-a6d0-4816-a92c-f369fe2564a6 req-8465c82f-8df9-4ebe-a59f-2388bf3dd035 service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-64168f14-a6d0-4816-a92c-f369fe2564a6 req-8465c82f-8df9-4ebe-a59f-2388bf3dd035 service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-64168f14-a6d0-4816-a92c-f369fe2564a6 req-8465c82f-8df9-4ebe-a59f-2388bf3dd035 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] No waiting events found dispatching network-vif-unplugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.compute.manager [req-64168f14-a6d0-4816-a92c-f369fe2564a6 req-8465c82f-8df9-4ebe-a59f-2388bf3dd035 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-vif-unplugged-0692d990-568e-48a2-8081-54adbc1eedb6 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Instance destroyed successfully.
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'resources' on Instance uuid 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352508805',display_name='tempest-TestVolumeBootPattern-server-1352508805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352508805',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-sa48ruvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:38:29Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=02c2bc15-18f6-4f54-a447-794ba5ed5cd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "0692d990-568e-48a2-8081-54adbc1eedb6", "address": "fa:16:3e:23:14:46", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0692d990-56", "ovs_interfaceid": "0692d990-568e-48a2-8081-54adbc1eedb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_vif [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0692d990-56, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:40:04 user nova-compute[73503]: INFO os_vif [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:14:46,bridge_name='br-int',has_traffic_filtering=True,id=0692d990-568e-48a2-8081-54adbc1eedb6,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0692d990-56')
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sXiPrypx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:40:04 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b70207-ed30-4df8-bdfc-6c003527afd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2beb619-2fb3-4d37-b4dd-1d3896212418]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:04 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:40:04 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:04 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:04 user nova-compute[73503]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e (non-flash)
Aug 26 13:40:04 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:04 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3044d1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d6c5b-ded8-4255-aef3-c67cc91fd25a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf790e9-8682-49f8-8f1e-7cb16ba0ddce]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e4c869-377b-41cb-9963-e8b4addd0135]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6268d9-a38d-4e98-b8f1-38f86691e6ed]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c9a51-69e2-4415-989f-ad3d69be5a38]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb15e2-294d-4578-9e94-193f3de6619f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260]
Aug 26 13:40:04 user nova-compute[73503]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e, portal: 172.16.0.220,3260] successful.
Aug 26 13:40:04 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64f98258-5c42-4642-a45f-b29c654a202e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499f398-530e-4e1b-ae86-25e9d1052a77]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== disconnect_volume: return (312ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:40:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Deleting instance files /opt/stack/data/nova/instances/02c2bc15-18f6-4f54-a447-794ba5ed5cd2_del
Aug 26 13:40:04 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Deletion of /opt/stack/data/nova/instances/02c2bc15-18f6-4f54-a447-794ba5ed5cd2_del complete
Aug 26 13:40:04 user nova-compute[73503]: INFO nova.compute.manager [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 26 13:40:04 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:40:04 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:40:05 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:05 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Took 0.59 seconds to deallocate network for instance.
Aug 26 13:40:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b85de85-fe46-44c3-ad69-b5d8fc75561b req-d0677222-83c7-4758-8bc9-f7ca4e7a5c51 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-vif-deleted-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:05 user nova-compute[73503]: INFO nova.compute.manager [req-1b85de85-fe46-44c3-ad69-b5d8fc75561b req-d0677222-83c7-4758-8bc9-f7ca4e7a5c51 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Neutron deleted interface 0692d990-568e-48a2-8081-54adbc1eedb6; detaching it from the instance and deleting it from the info cache
Aug 26 13:40:05 user nova-compute[73503]: DEBUG nova.network.neutron [req-1b85de85-fe46-44c3-ad69-b5d8fc75561b req-d0677222-83c7-4758-8bc9-f7ca4e7a5c51 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:05 user nova-compute[73503]: DEBUG nova.compute.manager [req-1b85de85-fe46-44c3-ad69-b5d8fc75561b req-d0677222-83c7-4758-8bc9-f7ca4e7a5c51 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Detach interface failed, port_id=0692d990-568e-48a2-8081-54adbc1eedb6, reason: Instance 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-11cdbf57-8cae-4cea-a358-c2b10aa19b89 req-c0e80fdc-3d86-4b5e-b7f2-1f06530c21d9 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received event network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-11cdbf57-8cae-4cea-a358-c2b10aa19b89 req-c0e80fdc-3d86-4b5e-b7f2-1f06530c21d9 service nova] Acquiring lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-11cdbf57-8cae-4cea-a358-c2b10aa19b89 req-c0e80fdc-3d86-4b5e-b7f2-1f06530c21d9 service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-11cdbf57-8cae-4cea-a358-c2b10aa19b89 req-c0e80fdc-3d86-4b5e-b7f2-1f06530c21d9 service nova] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG nova.compute.manager [req-11cdbf57-8cae-4cea-a358-c2b10aa19b89 req-c0e80fdc-3d86-4b5e-b7f2-1f06530c21d9 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] No waiting events found dispatching network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:40:06 user nova-compute[73503]: WARNING nova.compute.manager [req-11cdbf57-8cae-4cea-a358-c2b10aa19b89 req-c0e80fdc-3d86-4b5e-b7f2-1f06530c21d9 service nova] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Received unexpected event network-vif-plugged-0692d990-568e-48a2-8081-54adbc1eedb6 for instance with vm_state active and task_state deleting.
Aug 26 13:40:06 user nova-compute[73503]: INFO nova.compute.manager [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Took 0.92 seconds to detach 1 volumes for instance.
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:06 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Deleted allocations for instance 02c2bc15-18f6-4f54-a447-794ba5ed5cd2
Aug 26 13:40:06 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-f7109622-40d3-42fb-bebf-8054704a693a tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "02c2bc15-18f6-4f54-a447-794ba5ed5cd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.174s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057204.4221525, 02c2bc15-18f6-4f54-a447-794ba5ed5cd2 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:40:19 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] VM Stopped (Lifecycle Event)
Aug 26 13:40:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-8dbe6274-fcbf-44a6-ae25-5926a698603d None None] [instance: 02c2bc15-18f6-4f54-a447-794ba5ed5cd2] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:40:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-changed-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Refreshing instance network info cache due to event network-changed-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:40:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] Acquiring lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] Acquired lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Refreshing network info cache for port 4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updated VIF entry in instance network info cache for port 4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG nova.network.neutron [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating instance_info_cache with network_info: [{"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e88c0832-69de-47ee-9c7b-ae4c8da06bc0 req-9d5e1352-8ea1-4cdd-8a1d-7d0e284a764a service nova] Releasing lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG nova.objects.instance [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'flavor' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:27 user nova-compute[73503]: INFO nova.compute.manager [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attaching volume 3de9a452-aed0-4038-88dd-d1b134fd6f1c to /dev/vdb
Aug 26 13:40:27 user nova-compute[73503]: DEBUG os_brick.utils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[626b9283-63dc-49ac-a20b-8bbe5b732346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f7a70d-ec86-4478-a237-968acc24e31a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[27963841-e154-401d-a05a-0ea120417d6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2c264-d6a6-4502-bb32-29c387f46c08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:40:27 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cca3ee-eb44-4f30-aac1-ca8c6ebdadc4]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG os_brick.utils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating existing volume attachment record: ecf678c3-5e47-41af-a070-2e735e56a468 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:40:32 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid dc382e76-a52b-47d7-8772-d795658d9f38 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:33 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:40:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:40:36 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:40:36 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=24.956974029541016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance dc382e76-a52b-47d7-8772-d795658d9f38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bfbea0ed-730a-4477-9f87-a9b408c9485d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing instance network info cache due to event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OczIxMXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:40:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:40:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:40:38 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8ed2d-7632-4d2a-af53-c4f470f29068]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:40:38 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed69de1-51cf-4ab9-ad43-a8a5b4fe73cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c] added
Aug 26 13:40:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5ff917-a334-4fc6-89a5-02a5f38e1856]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068201a-9474-47f2-902e-8a6dfadd755b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OczIxMXa {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OczIxMXa" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22b8ad-78ed-4d36-be9c-6585176f180a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OczIxMXa'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be2b104-ed10-4707-b38e-ec20a8e33470]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d58393d-77b2-4414-a479-883212d24776]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:38 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:38 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[921f674b-1d85-40c0-8497-2c0ebe2518cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260]
Aug 26 13:40:38 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260] successful.
Aug 26 13:40:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a6801-08f3-4fe9-863e-5f35f52e59a9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f28216-4fbc-4b97-bd4f-785412d5d1ad]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:39 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:39 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:39 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:39 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d494bc52-2007-45d8-89c8-6979693c9f34]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OczIxMXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updated VIF entry in instance network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-9b39fe7a-43ca-481f-800a-37361167ac28 req-8998b67d-bab2-4609-b582-21e83c6ca71a service nova] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing instance network info cache due to event network-changed-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Refreshing network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:39 user nova-compute[73503]: INFO nova.compute.manager [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Detaching volume 7c383a53-19b2-45f0-a6f2-03a389236d39
Aug 26 13:40:40 user nova-compute[73503]: INFO nova.virt.block_device [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Attempting to driver detach volume 7c383a53-19b2-45f0-a6f2-03a389236d39 from mountpoint /dev/vdb
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Attempting to detach device vdb from instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:40:40 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:40:40 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:40:40 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:40:40 user nova-compute[73503]:   <serial>7c383a53-19b2-45f0-a6f2-03a389236d39</serial>
Aug 26 13:40:40 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:40:40 user nova-compute[73503]: </disk>
Aug 26 13:40:40 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:40:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully detached device vdb from instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 from the persistent domain config.
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:40:40 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:40:40 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:40:40 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:40:40 user nova-compute[73503]:   <serial>7c383a53-19b2-45f0-a6f2-03a389236d39</serial>
Aug 26 13:40:40 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 13:40:40 user nova-compute[73503]: </disk>
Aug 26 13:40:40 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23439363835373466', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439363835373466', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'flavor' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:40:40 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:40:40 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:40:40 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:40:40 user nova-compute[73503]:   <serial>3de9a452-aed0-4038-88dd-d1b134fd6f1c</serial>
Aug 26 13:40:40 user nova-compute[73503]: </disk>
Aug 26 13:40:40 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No VIF found with MAC fa:16:3e:c3:2d:26, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-849030c3-47cc-42e5-81a4-906323937d78 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.636s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057240.71568, 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:40:40 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully detached device vdb from instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 from the live domain config.
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPdMiGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:40:40 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7982ab82-a28c-452d-a396-71c66e142768]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1ef408-7433-4fc2-9eab-e9d331715008]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:40 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:40 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:40 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:40 user nova-compute[73503]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 (non-flash)
Aug 26 13:40:40 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:40 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30425ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db97c0-1887-4a35-817c-a8f8eb2f1117]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b9e0eb-7edf-457a-b531-ea88a3933678]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5aa85d-39f0-4669-916e-5e3b437c1ae6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updated VIF entry in instance network info cache for port 94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[364f59bf-4011-48c8-a7be-43765d95040f]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.085s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4bbd48-7216-4ba4-8a84-971c1374455a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e05a95d2-190f-400d-82ad-ab6084a9894d req-f703736d-cd3c-4e83-a04f-e766e30a87e5 service nova] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2850c7-9530-48a4-8b94-1fafba558a95]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260]
Aug 26 13:40:41 user nova-compute[73503]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39, portal: 172.16.0.220,3260] successful.
Aug 26 13:40:41 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c383a53-19b2-45f0-a6f2-03a389236d39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[40159456-72f9-4015-89b3-b7e6b55bc112]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== disconnect_volume: return (352ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG nova.objects.instance [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'flavor' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-29d038e3-431c-411f-b70b-f324200ada62 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:45 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'flavor' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:46 user nova-compute[73503]: INFO nova.compute.manager [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attaching volume 792f9463-8fa3-43b0-9d1f-7662167c71ba to /dev/vdc
Aug 26 13:40:46 user nova-compute[73503]: DEBUG os_brick.utils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c84e9a-7cdb-443f-8e64-4a8952a0c127]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[be95e39f-0111-45c8-84a4-a924000f4580]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c26a531-62d4-465b-9f84-22cf55f109b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57056f6-6ec0-437f-9bae-11a30f6a7161]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:40:46 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:40:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83780f56-f12f-4bfa-af0a-65f406538fd2]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG os_brick.utils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating existing volume attachment record: 5fbc7e3c-161a-457e-9323-621ba4cf275f {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:40:46 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:40:49 user nova-compute[73503]: INFO nova.compute.claims [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Claim successful on node user
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:40:49 user nova-compute[73503]: DEBUG nova.network.neutron [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:40:49 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.policy [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0cd9beab14694a7d935893335a7842f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69980bb88c054f2d8858c3ca9a4d0ac0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:40:50 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Creating image(s)
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "/opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "/opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "/opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk 1073741824" returned: 0 in 0.052s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Successfully created port: f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.197s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Cannot resize image /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Ensure instance console log exists: /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Successfully updated port: f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquired lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-changed-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Refreshing instance network info cache due to event network-changed-f1a565ed-8cbf-41d0-9130-d78ca21f03a5. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] Acquiring lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:40:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updating instance_info_cache with network_info: [{"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Releasing lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Instance network_info: |[{"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] Acquired lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Refreshing network info cache for port f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Start _get_guest_xml network_info=[{"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:40:52 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:40:52 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1723058',id=49,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV/3IHS+fxZq+Pe9m4OC/2X9igEraTq1qxAQR7ZhgzR8wwVlm8v/rMoVfWn25DxzjehtUfwRiJth3kf5uffvOKCnLwxFl1s7CZ3JyQGqLSZeJp5QzE23eunz4yjZtTIdg==',key_name='tempest-keypair-1453862178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69980bb88c054f2d8858c3ca9a4d0ac0',ramdisk_id='',reservation_id='r-blhuhmm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1712778482',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cd9beab14694a7d935893335a7842f6',uuid=d56ce7a5-5ff3-414c-900b-cb0effa00bd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Converting VIF {"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lazy-loading 'pci_devices' on Instance uuid d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:40:52 user nova-compute[73503]:   <uuid>d56ce7a5-5ff3-414c-900b-cb0effa00bd5</uuid>
Aug 26 13:40:52 user nova-compute[73503]:   <name>instance-00000031</name>
Aug 26 13:40:52 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:40:52 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:40:52 user nova-compute[73503]:   <metadata>
Aug 26 13:40:52 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:40:52 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:40:52 user nova-compute[73503]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935</nova:name>
Aug 26 13:40:52 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:40:52</nova:creationTime>
Aug 26 13:40:52 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:40:52 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:40:52 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:40:52 user nova-compute[73503]:       <nova:owner>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:user uuid="0cd9beab14694a7d935893335a7842f6">tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member</nova:user>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:project uuid="69980bb88c054f2d8858c3ca9a4d0ac0">tempest-TestServerVolumeAttachScenarioOldVersion-1712778482</nova:project>
Aug 26 13:40:52 user nova-compute[73503]:       </nova:owner>
Aug 26 13:40:52 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:40:52 user nova-compute[73503]:       <nova:ports>
Aug 26 13:40:52 user nova-compute[73503]:         <nova:port uuid="f1a565ed-8cbf-41d0-9130-d78ca21f03a5">
Aug 26 13:40:52 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 13:40:52 user nova-compute[73503]:         </nova:port>
Aug 26 13:40:52 user nova-compute[73503]:       </nova:ports>
Aug 26 13:40:52 user nova-compute[73503]:     </nova:instance>
Aug 26 13:40:52 user nova-compute[73503]:   </metadata>
Aug 26 13:40:52 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:40:52 user nova-compute[73503]:     <system>
Aug 26 13:40:52 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:40:52 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:40:52 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:40:52 user nova-compute[73503]:       <entry name="serial">d56ce7a5-5ff3-414c-900b-cb0effa00bd5</entry>
Aug 26 13:40:52 user nova-compute[73503]:       <entry name="uuid">d56ce7a5-5ff3-414c-900b-cb0effa00bd5</entry>
Aug 26 13:40:52 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:40:52 user nova-compute[73503]:     </system>
Aug 26 13:40:52 user nova-compute[73503]:   </sysinfo>
Aug 26 13:40:52 user nova-compute[73503]:   <os>
Aug 26 13:40:52 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:40:52 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:40:52 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:40:52 user nova-compute[73503]:   </os>
Aug 26 13:40:52 user nova-compute[73503]:   <features>
Aug 26 13:40:52 user nova-compute[73503]:     <acpi/>
Aug 26 13:40:52 user nova-compute[73503]:     <apic/>
Aug 26 13:40:52 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:40:52 user nova-compute[73503]:   </features>
Aug 26 13:40:52 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:40:52 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:40:52 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:40:52 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:40:52 user nova-compute[73503]:   </clock>
Aug 26 13:40:52 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:40:52 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:40:52 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:40:52 user nova-compute[73503]:   </cpu>
Aug 26 13:40:52 user nova-compute[73503]:   <devices>
Aug 26 13:40:52 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:40:52 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:40:52 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk"/>
Aug 26 13:40:52 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:40:52 user nova-compute[73503]:     </disk>
Aug 26 13:40:52 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:40:52 user nova-compute[73503]:       <mac address="fa:16:3e:07:36:bf"/>
Aug 26 13:40:52 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:40:52 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:40:52 user nova-compute[73503]:       <target dev="tapf1a565ed-8c"/>
Aug 26 13:40:52 user nova-compute[73503]:     </interface>
Aug 26 13:40:52 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:40:52 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/console.log" append="off"/>
Aug 26 13:40:52 user nova-compute[73503]:     </serial>
Aug 26 13:40:52 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:40:52 user nova-compute[73503]:     <video>
Aug 26 13:40:52 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:40:52 user nova-compute[73503]:     </video>
Aug 26 13:40:52 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:40:52 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:40:52 user nova-compute[73503]:     </rng>
Aug 26 13:40:52 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:40:52 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:40:52 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:40:52 user nova-compute[73503]:     </memballoon>
Aug 26 13:40:52 user nova-compute[73503]:   </devices>
Aug 26 13:40:52 user nova-compute[73503]: </domain>
Aug 26 13:40:52 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1723058',id=49,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV/3IHS+fxZq+Pe9m4OC/2X9igEraTq1qxAQR7ZhgzR8wwVlm8v/rMoVfWn25DxzjehtUfwRiJth3kf5uffvOKCnLwxFl1s7CZ3JyQGqLSZeJp5QzE23eunz4yjZtTIdg==',key_name='tempest-keypair-1453862178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69980bb88c054f2d8858c3ca9a4d0ac0',ramdisk_id='',reservation_id='r-blhuhmm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1712778482',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cd9beab14694a7d935893335a7842f6',uuid=d56ce7a5-5ff3-414c-900b-cb0effa00bd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Converting VIF {"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG os_vif [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1a565ed-8c, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1a565ed-8c, col_values=(('external_ids', {'iface-id': 'f1a565ed-8cbf-41d0-9130-d78ca21f03a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:36:bf', 'vm-uuid': 'd56ce7a5-5ff3-414c-900b-cb0effa00bd5'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:52 user nova-compute[73503]: INFO os_vif [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c')
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] No VIF found with MAC fa:16:3e:07:36:bf, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updated VIF entry in instance network info cache for port f1a565ed-8cbf-41d0-9130-d78ca21f03a5. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG nova.network.neutron [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updating instance_info_cache with network_info: [{"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:40:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-915a6dd0-318a-437d-b6f0-9d3d93192537 req-0b67f284-5a1f-45d9-99ed-1eade34db4f1 service nova] Releasing lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-ee02297f-1a1f-4ce8-b3cc-b93bb1dab7e4 req-c0a49c3f-5b6a-4a69-8c7b-c18fbb8f0b69 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ee02297f-1a1f-4ce8-b3cc-b93bb1dab7e4 req-c0a49c3f-5b6a-4a69-8c7b-c18fbb8f0b69 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ee02297f-1a1f-4ce8-b3cc-b93bb1dab7e4 req-c0a49c3f-5b6a-4a69-8c7b-c18fbb8f0b69 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ee02297f-1a1f-4ce8-b3cc-b93bb1dab7e4 req-c0a49c3f-5b6a-4a69-8c7b-c18fbb8f0b69 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-ee02297f-1a1f-4ce8-b3cc-b93bb1dab7e4 req-c0a49c3f-5b6a-4a69-8c7b-c18fbb8f0b69 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:40:53 user nova-compute[73503]: WARNING nova.compute.manager [req-ee02297f-1a1f-4ce8-b3cc-b93bb1dab7e4 req-c0a49c3f-5b6a-4a69-8c7b-c18fbb8f0b69 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state building and task_state spawning.
Aug 26 13:40:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-96f5a186-f36c-4e1b-9c2f-3d89ad028658 req-1e62113f-ad4c-490f-9aae-d8ea9134a541 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:40:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-96f5a186-f36c-4e1b-9c2f-3d89ad028658 req-1e62113f-ad4c-490f-9aae-d8ea9134a541 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:40:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-96f5a186-f36c-4e1b-9c2f-3d89ad028658 req-1e62113f-ad4c-490f-9aae-d8ea9134a541 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:40:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-96f5a186-f36c-4e1b-9c2f-3d89ad028658 req-1e62113f-ad4c-490f-9aae-d8ea9134a541 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-96f5a186-f36c-4e1b-9c2f-3d89ad028658 req-1e62113f-ad4c-490f-9aae-d8ea9134a541 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:40:55 user nova-compute[73503]: WARNING nova.compute.manager [req-96f5a186-f36c-4e1b-9c2f-3d89ad028658 req-1e62113f-ad4c-490f-9aae-d8ea9134a541 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state building and task_state spawning.
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057256.0244637, d56ce7a5-5ff3-414c-900b-cb0effa00bd5 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] VM Resumed (Lifecycle Event)
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Instance spawned successfully.
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057256.0259123, d56ce7a5-5ff3-414c-900b-cb0effa00bd5 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] VM Started (Lifecycle Event)
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 26 13:40:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:40:56 user nova-compute[73503]: INFO nova.compute.manager [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Took 6.67 seconds to build instance.
Aug 26 13:40:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-63c07baa-ea6f-441f-a694-ffe04056205f tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.774s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgFIbXpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:40:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:40:57 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:40:57 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce16e02-1cb9-44fe-b88d-7f01986eda8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:40:57 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e10921-f34e-493b-aff0-a0f2ec81a92e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba] added
Aug 26 13:40:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[209f638c-cbf8-41a0-9a6b-78db266f5566]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4147ea6-270c-49c7-be55-07b9c10a3998]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgFIbXpn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WgFIbXpn" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b28be-ac7f-43c5-b8d8-f579ea4afd40]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WgFIbXpn'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd660d48-1171-43ff-a9e3-6dc7034f5049]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[188b5a8c-1e8d-4ea1-a0cb-e7a152050f19]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:57 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:57 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db80ca6-565c-46b5-b3c1-c28d980ad4d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260]
Aug 26 13:40:57 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260] successful.
Aug 26 13:40:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d372bb1-d849-4c7b-89b0-117ed5647767]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce4709-09f2-4c32-ab73-03e7ebc67313]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:57 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:57 user nova-compute[73503]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba (non-flash)
Aug 26 13:40:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:40:57 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:40:57 user nova-compute[73503]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba (non-flash)
Aug 26 13:40:57 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be92f16-fbb9-4a12-9533-1e9003ca109b]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:40:57 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgFIbXpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:40:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:40:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:40:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23437666165313362', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:40:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437666165313362', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:40:58 user nova-compute[73503]: DEBUG nova.objects.instance [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'flavor' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:40:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:40:59 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:40:59 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:40:59 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:40:59 user nova-compute[73503]:   <serial>792f9463-8fa3-43b0-9d1f-7662167c71ba</serial>
Aug 26 13:40:59 user nova-compute[73503]: </disk>
Aug 26 13:40:59 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:40:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:40:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:40:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:40:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] No VIF found with MAC fa:16:3e:c3:2d:26, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:40:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-e7ea4360-21e3-489d-8b95-ea4f20d96593 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.605s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:00 user nova-compute[73503]: INFO nova.compute.manager [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Detaching volume 792f9463-8fa3-43b0-9d1f-7662167c71ba
Aug 26 13:41:00 user nova-compute[73503]: INFO nova.virt.block_device [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attempting to driver detach volume 792f9463-8fa3-43b0-9d1f-7662167c71ba from mountpoint /dev/vdc
Aug 26 13:41:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Attempting to detach device vdc from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:41:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:41:00 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:41:00 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:41:00 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:41:00 user nova-compute[73503]:   <serial>792f9463-8fa3-43b0-9d1f-7662167c71ba</serial>
Aug 26 13:41:00 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 13:41:00 user nova-compute[73503]: </disk>
Aug 26 13:41:00 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:41:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Successfully detached device vdc from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the persistent domain config.
Aug 26 13:41:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:41:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:41:00 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:41:00 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:41:00 user nova-compute[73503]:   <target dev="vdc" bus="virtio"/>
Aug 26 13:41:00 user nova-compute[73503]:   <serial>792f9463-8fa3-43b0-9d1f-7662167c71ba</serial>
Aug 26 13:41:00 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 13:41:00 user nova-compute[73503]: </disk>
Aug 26 13:41:00 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057261.0160167, bfbea0ed-730a-4477-9f87-a9b408c9485d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:41:01 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Successfully detached device vdc from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the live domain config.
Aug 26 13:41:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WgFIbXpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:41:01 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2033fe12-46e8-4cf7-9315-65c3ecc46c51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70457e7-c83b-4848-b3d0-12cadda238f5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:41:01 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:41:01 user nova-compute[73503]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba (non-flash)
Aug 26 13:41:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:41:01 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:41:01 user nova-compute[73503]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba (non-flash)
Aug 26 13:41:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304239c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b07fc-af1d-443c-b1b6-48e80b7afa34]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a61d979-9891-47cb-8bdd-34408c0086e8]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57855e54-8bde-42c3-bf38-513afeade5aa]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe70ae-17c6-4208-b1fc-e90d07830bcf]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfec9d-6df5-4983-85a1-2318f7e58be8]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8d1c75-d4b4-421b-a08a-58be7b9cd9d8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260]
Aug 26 13:41:01 user nova-compute[73503]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba, portal: 172.16.0.220,3260] successful.
Aug 26 13:41:01 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792f9463-8fa3-43b0-9d1f-7662167c71ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a766a20-beeb-46df-bbd9-4f93ec52f930]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] <== disconnect_volume: return (317ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:41:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:41:02 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'flavor' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:41:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9686209b-6a2d-4bad-8e3c-f665c37ef8d1 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-changed-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:08 user nova-compute[73503]: DEBUG nova.compute.manager [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Refreshing instance network info cache due to event network-changed-238f7459-6018-428d-a558-ed914d839f97. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:41:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] Acquiring lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:41:08 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] Acquired lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:41:08 user nova-compute[73503]: DEBUG nova.network.neutron [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Refreshing network info cache for port 238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dc382e76-a52b-47d7-8772-d795658d9f38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:09 user nova-compute[73503]: INFO nova.compute.manager [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Terminating instance
Aug 26 13:41:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updated VIF entry in instance network info cache for port 238f7459-6018-428d-a558-ed914d839f97. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG nova.network.neutron [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [{"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8ed267ce-f3ba-464f-ab64-1abd4484bd40 req-e5a512d1-6351-4d1c-ac45-601b65376bc4 service nova] Releasing lock "refresh_cache-dc382e76-a52b-47d7-8772-d795658d9f38" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Instance destroyed successfully.
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lazy-loading 'resources' on Instance uuid dc382e76-a52b-47d7-8772-d795658d9f38 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1426163395',display_name='tempest-TestVolumeBootPattern-server-1426163395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1426163395',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqorn9pUO9e7GI+AG3O4BIyA9THSdHtiEvjIwkQtaZATVyKa4kgHdDgYTkiqR+PDP9T7BUH/Zp5FZSgM/9gX5mTGlCLzKqprYuiuNf1wK23b10evWgGzmYlFRg8F+Eq7w==',key_name='tempest-TestVolumeBootPattern-922987732',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56c42bf18354f55954102eed4da2d58',ramdisk_id='',reservation_id='r-iyzl35h2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-813053503',owner_user_name='tempest-TestVolumeBootPattern-813053503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:36:20Z,user_data=None,user_id='122b92a79d3242f2903b15430240eace',uuid=dc382e76-a52b-47d7-8772-d795658d9f38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converting VIF {"id": "238f7459-6018-428d-a558-ed914d839f97", "address": "fa:16:3e:36:cc:fb", "network": {"id": "4b90efab-c6a7-4c33-be6c-ce1154e0db82", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663883056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56c42bf18354f55954102eed4da2d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap238f7459-60", "ovs_interfaceid": "238f7459-6018-428d-a558-ed914d839f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_vif [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap238f7459-60, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:41:10 user nova-compute[73503]: INFO os_vif [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:cc:fb,bridge_name='br-int',has_traffic_filtering=True,id=238f7459-6018-428d-a558-ed914d839f97,network=Network(4b90efab-c6a7-4c33-be6c-ce1154e0db82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap238f7459-60')
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIjrtcqV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:41:10 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.057s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d332f12-f79c-42c8-a2a8-27b7286143c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f30839d-c118-4aa0-b4e6-3b41c6a67ba9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:41:10 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:41:10 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 (non-flash)
Aug 26 13:41:10 user nova-compute[73503]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:41:10 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30463ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2'): ({'sdd'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Removing single pathed devices sdd {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d30759-882a-4579-a295-f6a241d948ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a9eb0-3f56-4211-b524-ae518bb080a7]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Flushing IO for device /dev/sdd {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ffb672-7164-4e5f-9b5e-ab9c847ea468]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e80ecb9-bca8-4ff6-994c-39f2ede2a09a]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] SCSI volumes sdd have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[592d9faa-af95-442c-937c-c7981e37d508]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9814cad6-0013-4535-a756-0831453a3565]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260]
Aug 26 13:41:10 user nova-compute[73503]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2, portal: 172.16.0.220,3260] successful.
Aug 26 13:41:10 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:772e71f4-cbf8-4639-ad90-bc0b488454f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c11da-283c-43e8-a1f5-43df3ac8af67]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] <== disconnect_volume: return (350ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:41:10 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Deleting instance files /opt/stack/data/nova/instances/dc382e76-a52b-47d7-8772-d795658d9f38_del
Aug 26 13:41:10 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Deletion of /opt/stack/data/nova/instances/dc382e76-a52b-47d7-8772-d795658d9f38_del complete
Aug 26 13:41:10 user nova-compute[73503]: INFO nova.compute.manager [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 26 13:41:10 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-vif-unplugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] No waiting events found dispatching network-vif-unplugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-vif-unplugged-238f7459-6018-428d-a558-ed914d839f97 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] Acquiring lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] Lock "dc382e76-a52b-47d7-8772-d795658d9f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:11 user nova-compute[73503]: DEBUG nova.compute.manager [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] No waiting events found dispatching network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:41:11 user nova-compute[73503]: WARNING nova.compute.manager [req-3948e675-9fde-4514-8b0b-aed2ca4da98b req-d24e8b95-6dd6-4c3b-ab3e-4c8f54582468 service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received unexpected event network-vif-plugged-238f7459-6018-428d-a558-ed914d839f97 for instance with vm_state active and task_state deleting.
Aug 26 13:41:11 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:41:11 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Took 0.58 seconds to deallocate network for instance.
Aug 26 13:41:12 user nova-compute[73503]: INFO nova.compute.manager [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Took 1.39 seconds to detach 1 volumes for instance.
Aug 26 13:41:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:12 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:41:12 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:41:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:12 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Deleted allocations for instance dc382e76-a52b-47d7-8772-d795658d9f38
Aug 26 13:41:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-24e15843-b8a0-4864-b569-37b3cbe9b74f tempest-TestVolumeBootPattern-813053503 tempest-TestVolumeBootPattern-813053503-project-member] Lock "dc382e76-a52b-47d7-8772-d795658d9f38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.886s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:13 user nova-compute[73503]: DEBUG nova.compute.manager [req-cbe770a1-c4ff-4889-8b63-dfc01f8031b7 req-44c7bdc0-8461-4461-b014-686d4ae30a3e service nova] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Received event network-vif-deleted-238f7459-6018-428d-a558-ed914d839f97 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:41:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:24 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057269.9954884, dc382e76-a52b-47d7-8772-d795658d9f38 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:41:24 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] VM Stopped (Lifecycle Event)
Aug 26 13:41:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-c18ea88c-063a-483c-b450-441debadbbb9 None None] [instance: dc382e76-a52b-47d7-8772-d795658d9f38] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:41:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:41:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:41:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:41:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:41:33 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [{"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:41:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:41:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:41:33 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:37 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:41:37 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8354MB free_disk=24.91584014892578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bfbea0ed-730a-4477-9f87-a9b408c9485d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:41:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:38 user nova-compute[73503]: INFO nova.compute.manager [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Terminating instance
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-397df166-8858-4187-912d-9c80ff11a290 req-cba4427d-bea0-42e7-bc24-be088268b9a5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-unplugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-397df166-8858-4187-912d-9c80ff11a290 req-cba4427d-bea0-42e7-bc24-be088268b9a5 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-397df166-8858-4187-912d-9c80ff11a290 req-cba4427d-bea0-42e7-bc24-be088268b9a5 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-397df166-8858-4187-912d-9c80ff11a290 req-cba4427d-bea0-42e7-bc24-be088268b9a5 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-397df166-8858-4187-912d-9c80ff11a290 req-cba4427d-bea0-42e7-bc24-be088268b9a5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-unplugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.compute.manager [req-397df166-8858-4187-912d-9c80ff11a290 req-cba4427d-bea0-42e7-bc24-be088268b9a5 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-unplugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Instance destroyed successfully.
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.objects.instance [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'resources' on Instance uuid 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:36:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1717550581',display_name='tempest-TestMinimumBasicScenario-server-1717550581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1717550581',id=46,image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTLRC03UdEqg7pC+RsyF073pr4L5bFbWnL0sREFh8VfjtPojwgSml38ZRVKikdsDbTmuOTLdJMPcvN6R/BRbkL1Uw0qCc6I2ITlaIZNYaMjXJngr/BRCTEVUt8EoJIdPA==',key_name='tempest-TestMinimumBasicScenario-2116688177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:36:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-cz260b2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1d7aeddf-84ce-4c03-b40c-629ee10a512e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:38:54Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "address": "fa:16:3e:51:21:d4", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b6a75b-9f", "ovs_interfaceid": "94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG os_vif [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94b6a75b-9f, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:41:38 user nova-compute[73503]: INFO os_vif [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:21:d4,bridge_name='br-int',has_traffic_filtering=True,id=94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b6a75b-9f')
Aug 26 13:41:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Deleting instance files /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9_del
Aug 26 13:41:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Deletion of /opt/stack/data/nova/instances/0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9_del complete
Aug 26 13:41:38 user nova-compute[73503]: INFO nova.compute.manager [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 13:41:38 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:41:38 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:41:39 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Took 0.50 seconds to deallocate network for instance.
Aug 26 13:41:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-75ee6f02-980d-4110-a692-48e267e8d557 req-269cf937-02a6-422a-889b-7e2eaf4379f2 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-deleted-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:41:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:39 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Deleted allocations for instance 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9
Aug 26 13:41:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-34f7d172-98b8-4a96-8c19-d03bc1fbffc8 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.785s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-4e8516c1-548f-4002-8a73-9fe306867da8 req-0f6a842b-04b3-4850-b596-d184addbaa68 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:41:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4e8516c1-548f-4002-8a73-9fe306867da8 req-0f6a842b-04b3-4850-b596-d184addbaa68 service nova] Acquiring lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4e8516c1-548f-4002-8a73-9fe306867da8 req-0f6a842b-04b3-4850-b596-d184addbaa68 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-4e8516c1-548f-4002-8a73-9fe306867da8 req-0f6a842b-04b3-4850-b596-d184addbaa68 service nova] Lock "0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:40 user nova-compute[73503]: DEBUG nova.compute.manager [req-4e8516c1-548f-4002-8a73-9fe306867da8 req-0f6a842b-04b3-4850-b596-d184addbaa68 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] No waiting events found dispatching network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:41:40 user nova-compute[73503]: WARNING nova.compute.manager [req-4e8516c1-548f-4002-8a73-9fe306867da8 req-0f6a842b-04b3-4850-b596-d184addbaa68 service nova] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Received unexpected event network-vif-plugged-94b6a75b-9ff5-4cfb-b4e0-38c6ffbfe64f for instance with vm_state deleted and task_state None.
Aug 26 13:41:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:41:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:41:51 user nova-compute[73503]: INFO nova.compute.manager [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Detaching volume 3de9a452-aed0-4038-88dd-d1b134fd6f1c
Aug 26 13:41:51 user nova-compute[73503]: INFO nova.virt.block_device [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Attempting to driver detach volume 3de9a452-aed0-4038-88dd-d1b134fd6f1c from mountpoint /dev/vdb
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Attempting to detach device vdb from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:41:51 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:41:51 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:41:51 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:41:51 user nova-compute[73503]:   <serial>3de9a452-aed0-4038-88dd-d1b134fd6f1c</serial>
Aug 26 13:41:51 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:41:51 user nova-compute[73503]: </disk>
Aug 26 13:41:51 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:41:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Successfully detached device vdb from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the persistent domain config.
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:41:51 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:41:51 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:41:51 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:41:51 user nova-compute[73503]:   <serial>3de9a452-aed0-4038-88dd-d1b134fd6f1c</serial>
Aug 26 13:41:51 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:41:51 user nova-compute[73503]: </disk>
Aug 26 13:41:51 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057311.5540354, bfbea0ed-730a-4477-9f87-a9b408c9485d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:41:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Successfully detached device vdb from instance bfbea0ed-730a-4477-9f87-a9b408c9485d from the live domain config.
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OczIxMXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:41:51 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1253ac6-2ea3-44d2-926f-039a2107497d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecba7be-343b-4c7c-b5a3-a3d58b4ec517]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:41:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c (non-flash)
Aug 26 13:41:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3044d3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59b2113-e371-4b47-947b-101d056bc828]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b305bf-5e3e-4247-bbe8-5d66230462aa]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0939e30e-9209-484b-8a9f-d574fdbdc60a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[073c3c3d-3ad1-4d5b-ab73-76e4aed823c8]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382e657-911e-45e0-88f0-a66c339f0635]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f5e22-b11e-4ea3-9f90-3632f0f67332]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260]
Aug 26 13:41:51 user nova-compute[73503]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c, portal: 172.16.0.220,3260] successful.
Aug 26 13:41:51 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3de9a452-aed0-4038-88dd-d1b134fd6f1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca65e6-cc41-47cc-9211-efd32851fc33]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] <== disconnect_volume: return (263ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:41:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:41:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'flavor' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:41:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5990336f-8fde-47a0-b58f-af2d9ceea37a tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:41:53 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057298.828328, 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:41:53 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] VM Stopped (Lifecycle Event)
Aug 26 13:41:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6bb77dcc-f6b4-4bb7-be22-0c721ed37bb2 None None] [instance: 0b77c700-f9c3-475a-b3ad-c39c3cb6b3b9] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:41:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:41:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:11 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:21 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:42:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:28 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:42:32 user nova-compute[73503]: INFO nova.compute.claims [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Claim successful on node user
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:42:32 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:42:32 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:42:33 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Creating image(s)
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "/opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "/opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "67e07549493e1589014d0a2391f5c9e69597d4c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "67e07549493e1589014d0a2391f5c9e69597d4c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.part --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG nova.policy [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '069e5b62e5904df6bef00673c3a83f0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0839baf2914ad9a087bee16cf3e1b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.part --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG nova.virt.images [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2 was qcow2, converting to raw {{(pid=73503) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG nova.privsep.utils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73503) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.part /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.converted {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.part /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.converted" returned: 0 in 0.360s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.converted --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "67e07549493e1589014d0a2391f5c9e69597d4c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.342s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating instance_info_cache with network_info: [{"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-bfbea0ed-730a-4477-9f87-a9b408c9485d" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7 --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "67e07549493e1589014d0a2391f5c9e69597d4c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "67e07549493e1589014d0a2391f5c9e69597d4c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Successfully created port: eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7 --force-share --output=json" returned: 0 in 0.207s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7,backing_fmt=raw /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7,backing_fmt=raw /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk 1073741824" returned: 0 in 0.060s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "67e07549493e1589014d0a2391f5c9e69597d4c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7 --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7 --force-share --output=json" returned: 0 in 0.202s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Cannot resize image /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Ensure instance console log exists: /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Successfully updated port: eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing instance network info cache due to event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance network_info: |[{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Start _get_guest_xml network_info=[{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:42:29Z,direct_url=<?>,disk_format='qcow2',id=bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2,min_disk=0,min_ram=0,name='tempest-scenario-img--774299108',owner='af0839baf2914ad9a087bee16cf3e1b5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:42:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': 'bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:42:35 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:42:35 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:42:29Z,direct_url=<?>,disk_format='qcow2',id=bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2,min_disk=0,min_ram=0,name='tempest-scenario-img--774299108',owner='af0839baf2914ad9a087bee16cf3e1b5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:42:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1069975812',display_name='tempest-TestMinimumBasicScenario-server-1069975812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1069975812',id=50,image_ref='bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeo89sVTIOGhBTjBgcNUjUiHKLhikCuN3tiQWUBe/ompwy3QaZbC75iFeaGJs+6I4/WLZGRxDEYsJ6kh8PscLFU3VKvzwKQt7im4cqvodZnA78qjgm0E5Qa9kjm99bqwg==',key_name='tempest-TestMinimumBasicScenario-758772911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-4myzbjb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:42:33Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=bdde09ab-a633-4955-9202-34ffaf60f9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'pci_devices' on Instance uuid bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:42:35 user nova-compute[73503]:   <uuid>bdde09ab-a633-4955-9202-34ffaf60f9bd</uuid>
Aug 26 13:42:35 user nova-compute[73503]:   <name>instance-00000032</name>
Aug 26 13:42:35 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:42:35 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:42:35 user nova-compute[73503]:   <metadata>
Aug 26 13:42:35 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:42:35 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:42:35 user nova-compute[73503]:       <nova:name>tempest-TestMinimumBasicScenario-server-1069975812</nova:name>
Aug 26 13:42:35 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:42:35</nova:creationTime>
Aug 26 13:42:35 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:42:35 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:42:35 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:42:35 user nova-compute[73503]:       <nova:owner>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:user uuid="069e5b62e5904df6bef00673c3a83f0d">tempest-TestMinimumBasicScenario-1890777113-project-member</nova:user>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:project uuid="af0839baf2914ad9a087bee16cf3e1b5">tempest-TestMinimumBasicScenario-1890777113</nova:project>
Aug 26 13:42:35 user nova-compute[73503]:       </nova:owner>
Aug 26 13:42:35 user nova-compute[73503]:       <nova:root type="image" uuid="bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2"/>
Aug 26 13:42:35 user nova-compute[73503]:       <nova:ports>
Aug 26 13:42:35 user nova-compute[73503]:         <nova:port uuid="eb6dfaed-33c5-4db6-831b-ff219fad52ae">
Aug 26 13:42:35 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:42:35 user nova-compute[73503]:         </nova:port>
Aug 26 13:42:35 user nova-compute[73503]:       </nova:ports>
Aug 26 13:42:35 user nova-compute[73503]:     </nova:instance>
Aug 26 13:42:35 user nova-compute[73503]:   </metadata>
Aug 26 13:42:35 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:42:35 user nova-compute[73503]:     <system>
Aug 26 13:42:35 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:42:35 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:42:35 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:42:35 user nova-compute[73503]:       <entry name="serial">bdde09ab-a633-4955-9202-34ffaf60f9bd</entry>
Aug 26 13:42:35 user nova-compute[73503]:       <entry name="uuid">bdde09ab-a633-4955-9202-34ffaf60f9bd</entry>
Aug 26 13:42:35 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:42:35 user nova-compute[73503]:     </system>
Aug 26 13:42:35 user nova-compute[73503]:   </sysinfo>
Aug 26 13:42:35 user nova-compute[73503]:   <os>
Aug 26 13:42:35 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:42:35 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:42:35 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:42:35 user nova-compute[73503]:   </os>
Aug 26 13:42:35 user nova-compute[73503]:   <features>
Aug 26 13:42:35 user nova-compute[73503]:     <acpi/>
Aug 26 13:42:35 user nova-compute[73503]:     <apic/>
Aug 26 13:42:35 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:42:35 user nova-compute[73503]:   </features>
Aug 26 13:42:35 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:42:35 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:42:35 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:42:35 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:42:35 user nova-compute[73503]:   </clock>
Aug 26 13:42:35 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:42:35 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:42:35 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:42:35 user nova-compute[73503]:   </cpu>
Aug 26 13:42:35 user nova-compute[73503]:   <devices>
Aug 26 13:42:35 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:42:35 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:42:35 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk"/>
Aug 26 13:42:35 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:42:35 user nova-compute[73503]:     </disk>
Aug 26 13:42:35 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:42:35 user nova-compute[73503]:       <mac address="fa:16:3e:c0:1e:a6"/>
Aug 26 13:42:35 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:42:35 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:42:35 user nova-compute[73503]:       <target dev="tapeb6dfaed-33"/>
Aug 26 13:42:35 user nova-compute[73503]:     </interface>
Aug 26 13:42:35 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:42:35 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/console.log" append="off"/>
Aug 26 13:42:35 user nova-compute[73503]:     </serial>
Aug 26 13:42:35 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:42:35 user nova-compute[73503]:     <video>
Aug 26 13:42:35 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:42:35 user nova-compute[73503]:     </video>
Aug 26 13:42:35 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:42:35 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:42:35 user nova-compute[73503]:     </rng>
Aug 26 13:42:35 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:42:35 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:42:35 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:42:35 user nova-compute[73503]:     </memballoon>
Aug 26 13:42:35 user nova-compute[73503]:   </devices>
Aug 26 13:42:35 user nova-compute[73503]: </domain>
Aug 26 13:42:35 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1069975812',display_name='tempest-TestMinimumBasicScenario-server-1069975812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1069975812',id=50,image_ref='bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeo89sVTIOGhBTjBgcNUjUiHKLhikCuN3tiQWUBe/ompwy3QaZbC75iFeaGJs+6I4/WLZGRxDEYsJ6kh8PscLFU3VKvzwKQt7im4cqvodZnA78qjgm0E5Qa9kjm99bqwg==',key_name='tempest-TestMinimumBasicScenario-758772911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-4myzbjb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:42:33Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=bdde09ab-a633-4955-9202-34ffaf60f9bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG os_vif [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb6dfaed-33, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb6dfaed-33, col_values=(('external_ids', {'iface-id': 'eb6dfaed-33c5-4db6-831b-ff219fad52ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:1e:a6', 'vm-uuid': 'bdde09ab-a633-4955-9202-34ffaf60f9bd'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:36 user nova-compute[73503]: INFO os_vif [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33')
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No VIF found with MAC fa:16:3e:c0:1e:a6, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated VIF entry in instance network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0e898120-00f0-406b-a74e-df6527a19769 req-883d8b58-d43f-45e1-9e8b-dcc52b267d3e service nova] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:42:36 user nova-compute[73503]: INFO nova.compute.claims [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Claim successful on node user
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:42:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.339s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:42:37 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.policy [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd8ed8aaa7740b1a64eae6248b78c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57e3b29058ee42259e2e9b6495f89947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:42:37 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Creating image(s)
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "/opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "/opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.232s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-164211b9-562e-4b27-aa0e-b16632046c0f req-79472d85-b557-4add-b8a2-c59100fdc691 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-164211b9-562e-4b27-aa0e-b16632046c0f req-79472d85-b557-4add-b8a2-c59100fdc691 service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-164211b9-562e-4b27-aa0e-b16632046c0f req-79472d85-b557-4add-b8a2-c59100fdc691 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-164211b9-562e-4b27-aa0e-b16632046c0f req-79472d85-b557-4add-b8a2-c59100fdc691 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-164211b9-562e-4b27-aa0e-b16632046c0f req-79472d85-b557-4add-b8a2-c59100fdc691 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:42:37 user nova-compute[73503]: WARNING nova.compute.manager [req-164211b9-562e-4b27-aa0e-b16632046c0f req-79472d85-b557-4add-b8a2-c59100fdc691 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state building and task_state spawning.
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.203s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk 1073741824" returned: 0 in 0.065s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.208s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Successfully created port: 6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Cannot resize image /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Ensure instance console log exists: /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Successfully updated port: 6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-changed-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Refreshing instance network info cache due to event network-changed-6232207c-8542-4457-916a-4cc128552aa8. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Refreshing network info cache for port 6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.network.neutron [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-0cac3d67-0527-4fdd-b3c3-78a3e77633b9 req-ee0f4818-093c-4fbe-8ed7-dea0aa35a896 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0cac3d67-0527-4fdd-b3c3-78a3e77633b9 req-ee0f4818-093c-4fbe-8ed7-dea0aa35a896 service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0cac3d67-0527-4fdd-b3c3-78a3e77633b9 req-ee0f4818-093c-4fbe-8ed7-dea0aa35a896 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0cac3d67-0527-4fdd-b3c3-78a3e77633b9 req-ee0f4818-093c-4fbe-8ed7-dea0aa35a896 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-0cac3d67-0527-4fdd-b3c3-78a3e77633b9 req-ee0f4818-093c-4fbe-8ed7-dea0aa35a896 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:42:39 user nova-compute[73503]: WARNING nova.compute.manager [req-0cac3d67-0527-4fdd-b3c3-78a3e77633b9 req-ee0f4818-093c-4fbe-8ed7-dea0aa35a896 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state building and task_state spawning.
Aug 26 13:42:39 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:42:39 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8440MB free_disk=24.910736083984375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057359.940155, bdde09ab-a633-4955-9202-34ffaf60f9bd => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:42:39 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] VM Resumed (Lifecycle Event)
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:42:39 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance spawned successfully.
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bfbea0ed-730a-4477-9f87-a9b408c9485d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bdde09ab-a633-4955-9202-34ffaf60f9bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:40 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057359.9404294, bdde09ab-a633-4955-9202-34ffaf60f9bd => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:42:40 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] VM Started (Lifecycle Event)
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:42:40 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:42:40 user nova-compute[73503]: INFO nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Took 7.04 seconds to spawn the instance on the hypervisor.
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.neutron [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2ec63d9f-ed69-416e-9c26-676d94e14730 req-c9d3553d-5ab8-43c7-9c2a-cf70239a8dc8 service nova] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:42:40 user nova-compute[73503]: INFO nova.compute.manager [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Took 7.82 seconds to build instance.
Aug 26 13:42:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9f582a0c-5dbb-4759-b16a-4b068c832830 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.921s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Instance network_info: |[{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Start _get_guest_xml network_info=[{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:42:40 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:42:40 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1870616382',display_name='tempest-SnapshotDataIntegrityTests-server-1870616382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1870616382',id=51,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaV/PXy3JNuXU6VRbuZOZ4VZcGvQUbrQZgtbpJQMQmrXYdsFbJNLxvOLYnPjIFpRSGLnb2ltmxYxR/2W42LnscJePLJKIMOaWEasbFwWgC5kgJx3WmoVWITtY8P4mjSfA==',key_name='tempest-keypair-401450881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57e3b29058ee42259e2e9b6495f89947',ramdisk_id='',reservation_id='r-wrwdyyzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1393965662',owner_user_name='tempest-SnapshotDataIntegrityTests-1393965662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:42:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd8ed8aaa7740b1a64eae6248b78c3a',uuid=fe3aa281-8f42-450c-adb8-ee53d86f4279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Converting VIF {"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'pci_devices' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:42:40 user nova-compute[73503]:   <uuid>fe3aa281-8f42-450c-adb8-ee53d86f4279</uuid>
Aug 26 13:42:40 user nova-compute[73503]:   <name>instance-00000033</name>
Aug 26 13:42:40 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:42:40 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:42:40 user nova-compute[73503]:   <metadata>
Aug 26 13:42:40 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:42:40 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:42:40 user nova-compute[73503]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1870616382</nova:name>
Aug 26 13:42:40 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:42:40</nova:creationTime>
Aug 26 13:42:40 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:42:40 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:42:40 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:42:40 user nova-compute[73503]:       <nova:owner>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:user uuid="6fd8ed8aaa7740b1a64eae6248b78c3a">tempest-SnapshotDataIntegrityTests-1393965662-project-member</nova:user>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:project uuid="57e3b29058ee42259e2e9b6495f89947">tempest-SnapshotDataIntegrityTests-1393965662</nova:project>
Aug 26 13:42:40 user nova-compute[73503]:       </nova:owner>
Aug 26 13:42:40 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:42:40 user nova-compute[73503]:       <nova:ports>
Aug 26 13:42:40 user nova-compute[73503]:         <nova:port uuid="6232207c-8542-4457-916a-4cc128552aa8">
Aug 26 13:42:40 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 13:42:40 user nova-compute[73503]:         </nova:port>
Aug 26 13:42:40 user nova-compute[73503]:       </nova:ports>
Aug 26 13:42:40 user nova-compute[73503]:     </nova:instance>
Aug 26 13:42:40 user nova-compute[73503]:   </metadata>
Aug 26 13:42:40 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:42:40 user nova-compute[73503]:     <system>
Aug 26 13:42:40 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:42:40 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:42:40 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:42:40 user nova-compute[73503]:       <entry name="serial">fe3aa281-8f42-450c-adb8-ee53d86f4279</entry>
Aug 26 13:42:40 user nova-compute[73503]:       <entry name="uuid">fe3aa281-8f42-450c-adb8-ee53d86f4279</entry>
Aug 26 13:42:40 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:42:40 user nova-compute[73503]:     </system>
Aug 26 13:42:40 user nova-compute[73503]:   </sysinfo>
Aug 26 13:42:40 user nova-compute[73503]:   <os>
Aug 26 13:42:40 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:42:40 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:42:40 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:42:40 user nova-compute[73503]:   </os>
Aug 26 13:42:40 user nova-compute[73503]:   <features>
Aug 26 13:42:40 user nova-compute[73503]:     <acpi/>
Aug 26 13:42:40 user nova-compute[73503]:     <apic/>
Aug 26 13:42:40 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:42:40 user nova-compute[73503]:   </features>
Aug 26 13:42:40 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:42:40 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:42:40 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:42:40 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:42:40 user nova-compute[73503]:   </clock>
Aug 26 13:42:40 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:42:40 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:42:40 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:42:40 user nova-compute[73503]:   </cpu>
Aug 26 13:42:40 user nova-compute[73503]:   <devices>
Aug 26 13:42:40 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:42:40 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:42:40 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk"/>
Aug 26 13:42:40 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:42:40 user nova-compute[73503]:     </disk>
Aug 26 13:42:40 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:42:40 user nova-compute[73503]:       <mac address="fa:16:3e:c2:c0:ec"/>
Aug 26 13:42:40 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:42:40 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:42:40 user nova-compute[73503]:       <target dev="tap6232207c-85"/>
Aug 26 13:42:40 user nova-compute[73503]:     </interface>
Aug 26 13:42:40 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:42:40 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/console.log" append="off"/>
Aug 26 13:42:40 user nova-compute[73503]:     </serial>
Aug 26 13:42:40 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:42:40 user nova-compute[73503]:     <video>
Aug 26 13:42:40 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:42:40 user nova-compute[73503]:     </video>
Aug 26 13:42:40 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:42:40 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:42:40 user nova-compute[73503]:     </rng>
Aug 26 13:42:40 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:42:40 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:42:40 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:42:40 user nova-compute[73503]:     </memballoon>
Aug 26 13:42:40 user nova-compute[73503]:   </devices>
Aug 26 13:42:40 user nova-compute[73503]: </domain>
Aug 26 13:42:40 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1870616382',display_name='tempest-SnapshotDataIntegrityTests-server-1870616382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1870616382',id=51,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaV/PXy3JNuXU6VRbuZOZ4VZcGvQUbrQZgtbpJQMQmrXYdsFbJNLxvOLYnPjIFpRSGLnb2ltmxYxR/2W42LnscJePLJKIMOaWEasbFwWgC5kgJx3WmoVWITtY8P4mjSfA==',key_name='tempest-keypair-401450881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57e3b29058ee42259e2e9b6495f89947',ramdisk_id='',reservation_id='r-wrwdyyzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1393965662',owner_user_name='tempest-SnapshotDataIntegrityTests-1393965662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:42:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd8ed8aaa7740b1a64eae6248b78c3a',uuid=fe3aa281-8f42-450c-adb8-ee53d86f4279,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Converting VIF {"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG os_vif [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6232207c-85, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6232207c-85, col_values=(('external_ids', {'iface-id': '6232207c-8542-4457-916a-4cc128552aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:c0:ec', 'vm-uuid': 'fe3aa281-8f42-450c-adb8-ee53d86f4279'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:40 user nova-compute[73503]: INFO os_vif [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85')
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:42:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No VIF found with MAC fa:16:3e:c2:c0:ec, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:41 user nova-compute[73503]: INFO nova.compute.manager [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Terminating instance
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9f13e59-2e35-4f6c-8d1f-5baaa8b4ac37 req-650f064f-a4c7-4bf7-9ec3-de1648f907d6 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-vif-unplugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9f13e59-2e35-4f6c-8d1f-5baaa8b4ac37 req-650f064f-a4c7-4bf7-9ec3-de1648f907d6 service nova] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9f13e59-2e35-4f6c-8d1f-5baaa8b4ac37 req-650f064f-a4c7-4bf7-9ec3-de1648f907d6 service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b9f13e59-2e35-4f6c-8d1f-5baaa8b4ac37 req-650f064f-a4c7-4bf7-9ec3-de1648f907d6 service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9f13e59-2e35-4f6c-8d1f-5baaa8b4ac37 req-650f064f-a4c7-4bf7-9ec3-de1648f907d6 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] No waiting events found dispatching network-vif-unplugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-b9f13e59-2e35-4f6c-8d1f-5baaa8b4ac37 req-650f064f-a4c7-4bf7-9ec3-de1648f907d6 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-vif-unplugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-changed-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Refreshing instance network info cache due to event network-changed-f1a565ed-8cbf-41d0-9130-d78ca21f03a5. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] Acquiring lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] Acquired lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:42:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Refreshing network info cache for port f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Instance destroyed successfully.
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.objects.instance [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lazy-loading 'resources' on Instance uuid bfbea0ed-730a-4477-9f87-a9b408c9485d {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1814889200',display_name='tempest-TestServerVolumeAttachmentScenario-server-1814889200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1814889200',id=48,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyaethgXB/D1QMmLQDYarTHPC8EyL70wokGFWuChnIFcYLrHQOXOnzWXxYZf2nEaS2cwSkvbaaWkIX2oVRlPaV4Xr8XayIc1e326/wrebxJEGd0lrb4kGsYZi2mGE/myg==',key_name='tempest-keypair-618410501',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3af3a7fd8cce4d93af5e44e69d99812b',ramdisk_id='',reservation_id='r-ajqkgnk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1086030976',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1086030976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='082caf1398334eafb04a0c56edf0f9f7',uuid=bfbea0ed-730a-4477-9f87-a9b408c9485d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Converting VIF {"id": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "address": "fa:16:3e:c3:2d:26", "network": {"id": "faedd4d7-d6b4-4b72-b647-97f2e0f34458", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-219518002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3af3a7fd8cce4d93af5e44e69d99812b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed3ad7a-64", "ovs_interfaceid": "4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG os_vif [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed3ad7a-64, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:42:42 user nova-compute[73503]: INFO os_vif [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:2d:26,bridge_name='br-int',has_traffic_filtering=True,id=4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d,network=Network(faedd4d7-d6b4-4b72-b647-97f2e0f34458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed3ad7a-64')
Aug 26 13:42:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Deleting instance files /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d_del
Aug 26 13:42:42 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Deletion of /opt/stack/data/nova/instances/bfbea0ed-730a-4477-9f87-a9b408c9485d_del complete
Aug 26 13:42:42 user nova-compute[73503]: INFO nova.compute.manager [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 26 13:42:42 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updated VIF entry in instance network info cache for port f1a565ed-8cbf-41d0-9130-d78ca21f03a5. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updating instance_info_cache with network_info: [{"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-f741a96c-f5ea-461c-8797-18624cf085d0 req-c2e59839-225c-4c40-bde0-901d784e8fbb service nova] Releasing lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] No waiting events found dispatching network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:42:43 user nova-compute[73503]: WARNING nova.compute.manager [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received unexpected event network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 for instance with vm_state building and task_state spawning.
Aug 26 13:42:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] No waiting events found dispatching network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:42:43 user nova-compute[73503]: WARNING nova.compute.manager [req-85b9bd0b-edcb-4dd5-ac08-5875787ca1be req-e45fd8e5-bf18-4951-933e-e43cd66b6746 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received unexpected event network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 for instance with vm_state building and task_state spawning.
Aug 26 13:42:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d29f6c5-6f42-413f-b776-cab94855bc6a req-876fa9de-ba43-4c60-8199-5543740ae9f9 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d29f6c5-6f42-413f-b776-cab94855bc6a req-876fa9de-ba43-4c60-8199-5543740ae9f9 service nova] Acquiring lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d29f6c5-6f42-413f-b776-cab94855bc6a req-876fa9de-ba43-4c60-8199-5543740ae9f9 service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6d29f6c5-6f42-413f-b776-cab94855bc6a req-876fa9de-ba43-4c60-8199-5543740ae9f9 service nova] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:43 user nova-compute[73503]: DEBUG nova.compute.manager [req-6d29f6c5-6f42-413f-b776-cab94855bc6a req-876fa9de-ba43-4c60-8199-5543740ae9f9 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] No waiting events found dispatching network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:42:43 user nova-compute[73503]: WARNING nova.compute.manager [req-6d29f6c5-6f42-413f-b776-cab94855bc6a req-876fa9de-ba43-4c60-8199-5543740ae9f9 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received unexpected event network-vif-plugged-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d for instance with vm_state active and task_state deleting.
Aug 26 13:42:44 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:42:44 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Took 1.39 seconds to deallocate network for instance.
Aug 26 13:42:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-425676c8-907f-4755-9895-1278fc97405c req-6a9fa640-e132-4b8f-abb8-67f8371282e1 service nova] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Received event network-vif-deleted-4ed3ad7a-64ba-4805-8da6-0dbbb4d88e6d {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:42:44 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:42:44 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:42:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:44 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Deleted allocations for instance bfbea0ed-730a-4477-9f87-a9b408c9485d
Aug 26 13:42:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fcfba191-06f9-4bef-91bd-aaa648529303 tempest-TestServerVolumeAttachmentScenario-1086030976 tempest-TestServerVolumeAttachmentScenario-1086030976-project-member] Lock "bfbea0ed-730a-4477-9f87-a9b408c9485d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.361s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057365.451743, fe3aa281-8f42-450c-adb8-ee53d86f4279 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] VM Resumed (Lifecycle Event)
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Instance spawned successfully.
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057365.4553566, fe3aa281-8f42-450c-adb8-ee53d86f4279 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] VM Started (Lifecycle Event)
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Took 8.22 seconds to spawn the instance on the hypervisor.
Aug 26 13:42:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:45 user nova-compute[73503]: INFO nova.compute.manager [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Took 9.10 seconds to build instance.
Aug 26 13:42:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9ff36581-d13d-4864-95ad-f10b7a6b65a4 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.244s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lazy-loading 'flavor' on Instance uuid d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:42:47 user nova-compute[73503]: INFO nova.compute.manager [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Attaching volume 911ed4f8-d56f-4a33-9825-546f2a68e8db to /dev/vdb
Aug 26 13:42:47 user nova-compute[73503]: DEBUG os_brick.utils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fc41d2-865c-4b4c-84af-c965aff3760e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd902fb-47f9-4fd4-855f-9ed21aec35b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104d574-8e5e-4b18-ab82-96750fd6addc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a2526-15cc-4ce1-b699-c1370d75add6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:42:47 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:42:47 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e5963-43d3-4d0a-bbe3-70ab7472d7fe]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG os_brick.utils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:42:47 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updating existing volume attachment record: 47429c15-fce0-4b5b-aee5-43f30e2b6c2f {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:42:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:57 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057362.568511, bfbea0ed-730a-4477-9f87-a9b408c9485d => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:42:57 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] VM Stopped (Lifecycle Event)
Aug 26 13:42:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-af4e320f-8d91-43ac-9326-b47d6113f789 None None] [instance: bfbea0ed-730a-4477-9f87-a9b408c9485d] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:42:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtYwvFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:42:59 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:42:59 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:42:59 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68191f-818e-42ae-8c1a-55bc17493d62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:42:59 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f3510a-59b7-4072-b077-8951f9bf3051]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db] added
Aug 26 13:42:59 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0e4a7-df6c-4665-ba13-af003c48ea90]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebbf7f-8afe-4e6e-b703-a5c82208888a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOtYwvFa {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOtYwvFa" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd50c76-f22a-45b2-8447-0ddea8e0ac5c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VOtYwvFa'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df04cb2-cd50-4473-aec8-2f94fd283519]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecd44cd-7308-4f2b-8b03-0c111acf5de2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:42:59 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:42:59 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:42:59 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:42:59 user nova-compute[73503]: 
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf072e4-10d5-47dc-aa86-280c9c997dc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260]
Aug 26 13:42:59 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260] successful.
Aug 26 13:42:59 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d490b79-a4ee-49af-a2c5-7f9edb008457]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f649bc8-b7f5-4dcf-9843-ff99d348fba8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db (non-flash)
Aug 26 13:42:59 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db (non-flash)
Aug 26 13:42:59 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[61073442-3b8c-414a-97e4-822bd965bd8d]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:42:59 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtYwvFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23961333735346166', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961333735346166', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lazy-loading 'flavor' on Instance uuid d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:43:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:43:00 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:43:00 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:43:00 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:43:00 user nova-compute[73503]:   <serial>911ed4f8-d56f-4a33-9825-546f2a68e8db</serial>
Aug 26 13:43:00 user nova-compute[73503]: </disk>
Aug 26 13:43:00 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:43:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:43:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:43:01 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] No VIF found with MAC fa:16:3e:07:36:bf, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:43:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9a693748-6018-4c30-b824-97b42e2e6d59 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.544s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:43:02 user nova-compute[73503]: INFO nova.compute.manager [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Detaching volume 911ed4f8-d56f-4a33-9825-546f2a68e8db
Aug 26 13:43:02 user nova-compute[73503]: INFO nova.virt.block_device [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Attempting to driver detach volume 911ed4f8-d56f-4a33-9825-546f2a68e8db from mountpoint /dev/vdb
Aug 26 13:43:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Attempting to detach device vdb from instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:43:02 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:43:02 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:43:02 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:43:02 user nova-compute[73503]:   <serial>911ed4f8-d56f-4a33-9825-546f2a68e8db</serial>
Aug 26 13:43:02 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:43:02 user nova-compute[73503]: </disk>
Aug 26 13:43:02 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:43:02 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Successfully detached device vdb from instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 from the persistent domain config.
Aug 26 13:43:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:43:02 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:43:02 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:43:02 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:43:02 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:43:02 user nova-compute[73503]:   <serial>911ed4f8-d56f-4a33-9825-546f2a68e8db</serial>
Aug 26 13:43:02 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:43:02 user nova-compute[73503]: </disk>
Aug 26 13:43:02 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057383.3866942, d56ce7a5-5ff3-414c-900b-cb0effa00bd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:43:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Successfully detached device vdb from instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 from the live domain config.
Aug 26 13:43:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOtYwvFa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:43:03 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c32f0-b2bb-4778-abc4-fc4214f3281f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdda04ce-3c74-49a6-aa41-34754cc93eba]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db (non-flash)
Aug 26 13:43:03 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db (non-flash)
Aug 26 13:43:03 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3141e60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d00d9-d3be-48d9-8474-02bebcdf7feb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73ba979-eba5-49c3-840a-3b398565c678]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce86015-f284-460b-a7ac-b126aa7b9b08]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0223d6-a6f7-4c3a-a3b4-a1b539f62ba9]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[742bed56-fe8d-4f28-ab75-d244e1f70a98]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aba08c-a84a-4193-a1de-6c85bf3ef716]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260]
Aug 26 13:43:03 user nova-compute[73503]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db, portal: 172.16.0.220,3260] successful.
Aug 26 13:43:03 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911ed4f8-d56f-4a33-9825-546f2a68e8db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1de9ae2-fe05-423b-8de6-5836ff574bed]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] <== disconnect_volume: return (295ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:43:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:43:04 user nova-compute[73503]: DEBUG nova.objects.instance [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lazy-loading 'flavor' on Instance uuid d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:43:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-16b3fa4e-8199-4e3a-af06-cd4ff577ebb0 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.733s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:43:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:12 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:20 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:22 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:43:23 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:43:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:43:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:43:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:43:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:43:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:43:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:43:34 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:43:35 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updating instance_info_cache with network_info: [{"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:43:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-d56ce7a5-5ff3-414c-900b-cb0effa00bd5" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:43:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:43:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:43:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:43:40 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:43:40 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8406MB free_disk=24.879623413085938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bdde09ab-a633-4955-9202-34ffaf60f9bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:43:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:43:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:43:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:43:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:43:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:43:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:43:42 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:52 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:43:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:43:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:43:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:43:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:43:59 user nova-compute[73503]: INFO nova.compute.manager [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Terminating instance
Aug 26 13:43:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:43:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-0eb9a6a8-4711-494d-aa95-e52fd772eae3 req-06bf2e8d-a78b-4ac6-be6c-6dcfc8a8f410 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-unplugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0eb9a6a8-4711-494d-aa95-e52fd772eae3 req-06bf2e8d-a78b-4ac6-be6c-6dcfc8a8f410 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0eb9a6a8-4711-494d-aa95-e52fd772eae3 req-06bf2e8d-a78b-4ac6-be6c-6dcfc8a8f410 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0eb9a6a8-4711-494d-aa95-e52fd772eae3 req-06bf2e8d-a78b-4ac6-be6c-6dcfc8a8f410 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-0eb9a6a8-4711-494d-aa95-e52fd772eae3 req-06bf2e8d-a78b-4ac6-be6c-6dcfc8a8f410 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-unplugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.compute.manager [req-0eb9a6a8-4711-494d-aa95-e52fd772eae3 req-06bf2e8d-a78b-4ac6-be6c-6dcfc8a8f410 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-unplugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Instance destroyed successfully.
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.objects.instance [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lazy-loading 'resources' on Instance uuid d56ce7a5-5ff3-414c-900b-cb0effa00bd5 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:40:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1723058935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1723058',id=49,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV/3IHS+fxZq+Pe9m4OC/2X9igEraTq1qxAQR7ZhgzR8wwVlm8v/rMoVfWn25DxzjehtUfwRiJth3kf5uffvOKCnLwxFl1s7CZ3JyQGqLSZeJp5QzE23eunz4yjZtTIdg==',key_name='tempest-keypair-1453862178',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:40:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69980bb88c054f2d8858c3ca9a4d0ac0',ramdisk_id='',reservation_id='r-blhuhmm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1712778482',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0cd9beab14694a7d935893335a7842f6',uuid=d56ce7a5-5ff3-414c-900b-cb0effa00bd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Converting VIF {"id": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "address": "fa:16:3e:07:36:bf", "network": {"id": "dd498682-be35-45a4-bb68-eb23341309cf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-185532446-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69980bb88c054f2d8858c3ca9a4d0ac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1a565ed-8c", "ovs_interfaceid": "f1a565ed-8cbf-41d0-9130-d78ca21f03a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG os_vif [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1a565ed-8c, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:00 user nova-compute[73503]: INFO os_vif [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:36:bf,bridge_name='br-int',has_traffic_filtering=True,id=f1a565ed-8cbf-41d0-9130-d78ca21f03a5,network=Network(dd498682-be35-45a4-bb68-eb23341309cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1a565ed-8c')
Aug 26 13:44:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Deleting instance files /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5_del
Aug 26 13:44:00 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Deletion of /opt/stack/data/nova/instances/d56ce7a5-5ff3-414c-900b-cb0effa00bd5_del complete
Aug 26 13:44:00 user nova-compute[73503]: INFO nova.compute.manager [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 13:44:00 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:44:00 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:44:01 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Took 1.11 seconds to deallocate network for instance.
Aug 26 13:44:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-a658b4da-3a81-435c-b331-0afab70c5455 req-360b934f-0b3c-4d0e-9c39-57ec5004b07b service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-deleted-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:44:01 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:02 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Deleted allocations for instance d56ce7a5-5ff3-414c-900b-cb0effa00bd5
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:02 user nova-compute[73503]: WARNING nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state deleted and task_state None.
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:02 user nova-compute[73503]: WARNING nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state deleted and task_state None.
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:02 user nova-compute[73503]: WARNING nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state deleted and task_state None.
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-unplugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-unplugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:02 user nova-compute[73503]: WARNING nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-unplugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state deleted and task_state None.
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Acquiring lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:02 user nova-compute[73503]: DEBUG nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] No waiting events found dispatching network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:02 user nova-compute[73503]: WARNING nova.compute.manager [req-0f37af4a-43ef-4dab-be2e-757d95b23901 req-3526ba34-64e9-4197-8ce1-a765042121c9 service nova] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Received unexpected event network-vif-plugged-f1a565ed-8cbf-41d0-9130-d78ca21f03a5 for instance with vm_state deleted and task_state None.
Aug 26 13:44:02 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-19e15c4c-e63f-4947-9a83-e95858bb6a07 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482 tempest-TestServerVolumeAttachScenarioOldVersion-1712778482-project-member] Lock "d56ce7a5-5ff3-414c-900b-cb0effa00bd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:44:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:44:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:44:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057440.527666, d56ce7a5-5ff3-414c-900b-cb0effa00bd5 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:44:15 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] VM Stopped (Lifecycle Event)
Aug 26 13:44:15 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6618b7c4-0d76-45c7-aa49-f783ecf9b739 None None] [instance: d56ce7a5-5ff3-414c-900b-cb0effa00bd5] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:44:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:21 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:44:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:44:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:44:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:44:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:44:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:26 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'flavor' on Instance uuid bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:44:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:27 user nova-compute[73503]: INFO nova.compute.manager [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Attaching volume 18db3176-edd0-4e7c-b517-1d14df2cf508 to /dev/vdb
Aug 26 13:44:27 user nova-compute[73503]: DEBUG os_brick.utils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee30033-978c-4441-a250-9dd9d9529426]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d862dc24-f689-427d-ae3a-34559637f2d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc654d7-e559-4ede-a7e5-bcf6e8278ee2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[649cff18-d3ae-44ed-927d-b031073c24ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:44:27 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca65051-a1b7-432f-b25e-f008f0574269]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG os_brick.utils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating existing volume attachment record: 980b55bf-6ebb-4537-b577-b9af6f5d983e {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-changed-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG nova.compute.manager [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Refreshing instance network info cache due to event network-changed-6232207c-8542-4457-916a-4cc128552aa8. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:44:27 user nova-compute[73503]: DEBUG nova.network.neutron [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Refreshing network info cache for port 6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:44:28 user nova-compute[73503]: DEBUG nova.network.neutron [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updated VIF entry in instance network info cache for port 6232207c-8542-4457-916a-4cc128552aa8. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:44:28 user nova-compute[73503]: DEBUG nova.network.neutron [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:44:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-acbca466-3b5b-4691-86dc-5639a096b078 req-4c3b216b-3e9c-4eaa-8092-e9acae8b7b02 service nova] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:44:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:33 user nova-compute[73503]: INFO nova.compute.manager [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attaching volume 3bef2f8b-8e96-45eb-9250-dc102cd168b8 to /dev/vdb
Aug 26 13:44:33 user nova-compute[73503]: DEBUG os_brick.utils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596058f-c5bf-4911-a33a-2f69fff6d898]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ef0b40-b4aa-40f6-bf83-ae81939c6c0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b3403d-9439-4f83-a62c-5551022ec669]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b863a-3750-4f26-a5b7-cf0911c3c9d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:44:33 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:44:33 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e94d0-0114-4664-98e6-9bc5666e0451]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG os_brick.utils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating existing volume attachment record: 171b49c2-1a3c-451a-9156-186cd61d5e21 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:44:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:36 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:44:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:44:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:44:36 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sctabVOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:44:37 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:44:37 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:44:37 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d02c2-6738-4584-95b8-6183a5aed18d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:44:37 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b90303-7e87-4f46-b7df-298a489f804e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508] added
Aug 26 13:44:37 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba75461-7609-43c5-8385-531c5ae13765]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dd72bc-5e03-4a8a-aabe-ca5190338e53]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sctabVOg {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sctabVOg" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7c3424-98d1-4342-a315-2e76a5f3e8ca]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sctabVOg'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed4cae-5e36-4e93-91c7-0a9541373c52]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[678fcbac-40ce-4f36-b335-44109169e85b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:44:37 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:44:37 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:44:37 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:44:37 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:44:37 user nova-compute[73503]: 
Aug 26 13:44:37 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8faa1-471d-4f18-9811-32a742b9ef7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260]
Aug 26 13:44:38 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260] successful.
Aug 26 13:44:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d877a8-ddd9-432d-bc03-1e254ae9ff9f]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b71670-e501-4b9c-8d38-1aa6f8b92fb8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:44:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:44:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57509e5-cd1a-446a-ba9a-5b66c5545f8a]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:44:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sctabVOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '23537316161326137', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537316161326137', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.objects.instance [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'flavor' on Instance uuid bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:44:39 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:44:39 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:44:39 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:44:39 user nova-compute[73503]:   <serial>18db3176-edd0-4e7c-b517-1d14df2cf508</serial>
Aug 26 13:44:39 user nova-compute[73503]: </disk>
Aug 26 13:44:39 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] No VIF found with MAC fa:16:3e:c0:1e:a6, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-db4db8ea-862d-44f1-8df2-acbd71aef2a3 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.615s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:40 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:44:40 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:44:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8573MB free_disk=24.897537231445312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bdde09ab-a633-4955-9202-34ffaf60f9bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.compute.manager [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing instance network info cache due to event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:44:41 user nova-compute[73503]: DEBUG nova.network.neutron [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:44:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated VIF entry in instance network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:44:42 user nova-compute[73503]: DEBUG nova.network.neutron [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:44:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-46506715-8f43-4a5a-8d79-5dca00115557 req-0cbf8410-bcac-441e-9519-b216ae9cd5ac service nova] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imrHGfEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:44:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:44:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:44:43 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9974ca-7bcb-44a7-975c-1c919ddb3275]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:44:43 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c82abd-a60f-4ebd-9bed-53308f2f5140]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8] added
Aug 26 13:44:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c99046-341a-42ff-aa4c-69088125898c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ec15f7-6fef-4705-ba56-899a8a190402]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imrHGfEq {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imrHGfEq" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18c70e5-08fd-4aac-b0fa-37694a937c34]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imrHGfEq'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[487bfb4f-5cb7-4d0b-a63c-3b173688dc5a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d16393-36a9-467b-bf38-50eddb329560]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:44:44 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:44:44 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3d4adc-fa91-429d-a9e2-5ab3dc94bc5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260]
Aug 26 13:44:44 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260] successful.
Aug 26 13:44:44 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dad970-ddf4-4b41-be83-5e8136803a11]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[182685fb-7668-40df-a7f7-f6e21f3e60c6]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:44:44 user nova-compute[73503]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 (non-flash)
Aug 26 13:44:44 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:44:44 user nova-compute[73503]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 (non-flash)
Aug 26 13:44:44 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc43202-f506-4a65-b057-32d7cf556328]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imrHGfEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG nova.compute.manager [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing instance network info cache due to event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:44 user nova-compute[73503]: INFO nova.compute.manager [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Rebooting instance
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated VIF entry in instance network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG nova.network.neutron [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-faa6ad92-d923-4f88-b307-f315a39b79cf req-1137e28a-55f1-4241-a898-f979cef0dfc6 service nova] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:44:44 user nova-compute[73503]: DEBUG nova.network.neutron [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.network.neutron [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23737343764643433', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737343764643433', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:44:45 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:44:45 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:44:45 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:44:45 user nova-compute[73503]:   <serial>3bef2f8b-8e96-45eb-9250-dc102cd168b8</serial>
Aug 26 13:44:45 user nova-compute[73503]: </disk>
Aug 26 13:44:45 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No VIF found with MAC fa:16:3e:c2:c0:ec, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4a9e41ac-836b-41d2-84d2-a4f2210ed1a8 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.463s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8910974-8ad2-42cb-b03d-7df2dfbd5039 req-b5347fba-6a33-487e-aa90-3d2be0ee0f22 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-unplugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8910974-8ad2-42cb-b03d-7df2dfbd5039 req-b5347fba-6a33-487e-aa90-3d2be0ee0f22 service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8910974-8ad2-42cb-b03d-7df2dfbd5039 req-b5347fba-6a33-487e-aa90-3d2be0ee0f22 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d8910974-8ad2-42cb-b03d-7df2dfbd5039 req-b5347fba-6a33-487e-aa90-3d2be0ee0f22 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:47 user nova-compute[73503]: DEBUG nova.compute.manager [req-d8910974-8ad2-42cb-b03d-7df2dfbd5039 req-b5347fba-6a33-487e-aa90-3d2be0ee0f22 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-unplugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:47 user nova-compute[73503]: WARNING nova.compute.manager [req-d8910974-8ad2-42cb-b03d-7df2dfbd5039 req-b5347fba-6a33-487e-aa90-3d2be0ee0f22 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-unplugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state active and task_state reboot_started.
Aug 26 13:44:48 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance shutdown successfully.
Aug 26 13:44:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-147612e1-106e-4447-95af-0b11f3d57b51 req-da4b5094-2cb3-4db8-9e90-eb36cec7e205 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-147612e1-106e-4447-95af-0b11f3d57b51 req-da4b5094-2cb3-4db8-9e90-eb36cec7e205 service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-147612e1-106e-4447-95af-0b11f3d57b51 req-da4b5094-2cb3-4db8-9e90-eb36cec7e205 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-147612e1-106e-4447-95af-0b11f3d57b51 req-da4b5094-2cb3-4db8-9e90-eb36cec7e205 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:49 user nova-compute[73503]: DEBUG nova.compute.manager [req-147612e1-106e-4447-95af-0b11f3d57b51 req-da4b5094-2cb3-4db8-9e90-eb36cec7e205 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:49 user nova-compute[73503]: WARNING nova.compute.manager [req-147612e1-106e-4447-95af-0b11f3d57b51 req-da4b5094-2cb3-4db8-9e90-eb36cec7e205 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state active and task_state reboot_started.
Aug 26 13:44:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Removed pending event for bdde09ab-a633-4955-9202-34ffaf60f9bd due to event {{(pid=73503) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057491.7986686, bdde09ab-a633-4955-9202-34ffaf60f9bd => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:44:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] VM Resumed (Lifecycle Event)
Aug 26 13:44:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance running successfully.
Aug 26 13:44:51 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance soft rebooted successfully.
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:51 user nova-compute[73503]: WARNING nova.compute.manager [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state active and task_state reboot_started.
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:44:51 user nova-compute[73503]: WARNING nova.compute.manager [req-02f1b04f-fcd9-41c7-bc47-677745d85779 req-63416ba7-e949-4c88-a93b-5582d0941dfc service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state active and task_state reboot_started.
Aug 26 13:44:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057491.8021162, bdde09ab-a633-4955-9202-34ffaf60f9bd => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:44:51 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] VM Started (Lifecycle Event)
Aug 26 13:44:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-fb79f8ea-1f7f-4a1e-bb17-d8a2dd50b767 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.336s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:44:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:44:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:44:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:45:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:45:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:45:17 user nova-compute[73503]: INFO nova.compute.manager [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Detaching volume 3bef2f8b-8e96-45eb-9250-dc102cd168b8
Aug 26 13:45:17 user nova-compute[73503]: INFO nova.virt.block_device [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attempting to driver detach volume 3bef2f8b-8e96-45eb-9250-dc102cd168b8 from mountpoint /dev/vdb
Aug 26 13:45:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Attempting to detach device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:45:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:45:17 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:45:17 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:45:17 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:45:17 user nova-compute[73503]:   <serial>3bef2f8b-8e96-45eb-9250-dc102cd168b8</serial>
Aug 26 13:45:17 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:45:17 user nova-compute[73503]: </disk>
Aug 26 13:45:17 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:45:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config.
Aug 26 13:45:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:45:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:45:17 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:45:17 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:45:17 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:45:17 user nova-compute[73503]:   <serial>3bef2f8b-8e96-45eb-9250-dc102cd168b8</serial>
Aug 26 13:45:17 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:45:17 user nova-compute[73503]: </disk>
Aug 26 13:45:17 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057518.3941822, fe3aa281-8f42-450c-adb8-ee53d86f4279 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:45:18 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config.
Aug 26 13:45:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imrHGfEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:45:18 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b3a44-c6aa-40c4-82a7-bb9b492299c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa825c8a-818b-4e36-b85f-7bcbda0c6975]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:45:18 user nova-compute[73503]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 (non-flash)
Aug 26 13:45:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:45:18 user nova-compute[73503]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 (non-flash)
Aug 26 13:45:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3141e7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942782b-2a4b-40cb-8b59-247a75f65aeb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9588b1e-cd76-4e61-a595-91972e1cdc0a]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e44479-5111-4916-ac2a-98186cb3d1ca]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8a2cd-3587-4e63-8f4a-d6f6bf1b96b7]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7623c937-78e0-4bc7-af89-1671bf7c87de]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96340fc-b0b2-4afc-9cc5-6e8f0407b927]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260]
Aug 26 13:45:18 user nova-compute[73503]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8, portal: 172.16.0.220,3260] successful.
Aug 26 13:45:18 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bef2f8b-8e96-45eb-9250-dc102cd168b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4b3d6-3c51-44dd-b90d-b04f5f7d2a6a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== disconnect_volume: return (286ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:45:18 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:45:19 user nova-compute[73503]: DEBUG nova.objects.instance [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:45:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-188af382-6515-4da1-aa92-976498b819bf tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:45:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:45:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:33 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:45:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:45:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:45:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:45:39 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:45:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:45:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:40 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:41 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:45:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:45:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:45:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:45:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=24.894638061523438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bdde09ab-a633-4955-9202-34ffaf60f9bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:45:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:45:43 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:45:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:45:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:45:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:45:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:45:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:45:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:45:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:46:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:46:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:46:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:46:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:46:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:11 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG nova.objects.instance [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:12 user nova-compute[73503]: INFO nova.compute.manager [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attaching volume a85c742d-71be-46f5-8184-09dec1aef24a to /dev/vdb
Aug 26 13:46:12 user nova-compute[73503]: DEBUG os_brick.utils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6462e8f4-5826-4c24-b19b-272866da8307]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b6bbe1-2b9c-44bf-a690-77c23b64a5cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21502416-c205-415c-89e5-f7f605a66791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e4b7ca-2643-4a27-b035-d02f6002e81d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:46:12 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:46:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3946bc51-8457-47d8-8151-d705a601eb32]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG os_brick.utils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:46:12 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating existing volume attachment record: bbd4616d-cff4-47a0-bb10-6f7f215e423e {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:46:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSbBPDVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:46:22 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:46:22 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:46:22 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0b74c9-1a6a-464c-8d0d-dfacd6039bec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:46:22 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8affe1-cb55-4e1f-840e-43d32df27cef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a] added
Aug 26 13:46:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca962c9-509c-413a-ab5b-26b0abca00a1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b1a5c-2395-4580-b0ad-83ce5348fb38]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cSbBPDVI {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cSbBPDVI" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac8355-85e0-477b-834f-9ae24213f133]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cSbBPDVI'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7044c79-9ee9-4946-8622-f8581806cece]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[48816825-9261-43c6-951a-972cbdcfac8b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff77bd0-4f5e-43b1-ad55-16f1bb13073e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260]
Aug 26 13:46:22 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260] successful.
Aug 26 13:46:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90bbbf-0169-42a9-b70b-af0c02a37205]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[288dbcce-4311-47a9-a63a-c470b1aab8c8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:22 user nova-compute[73503]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a (non-flash)
Aug 26 13:46:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:22 user nova-compute[73503]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a (non-flash)
Aug 26 13:46:22 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeb9638-197c-42d7-b2db-91f521d24f31]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:46:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSbBPDVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:46:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:46:23 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23466383265393962', 'path': '/dev/sdc'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:46:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466383265393962', 'path': '/dev/sdc'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:46:23 user nova-compute[73503]: DEBUG nova.objects.instance [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:46:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:46:23 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:46:23 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:46:23 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:46:23 user nova-compute[73503]:   <serial>a85c742d-71be-46f5-8184-09dec1aef24a</serial>
Aug 26 13:46:23 user nova-compute[73503]: </disk>
Aug 26 13:46:23 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:46:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:46:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:46:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No VIF found with MAC fa:16:3e:c2:c0:ec, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:46:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-196b2920-495c-44b4-9dd3-b3f8c6ff051b tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.165s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:46:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:25 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:27 user nova-compute[73503]: INFO nova.compute.manager [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Detaching volume a85c742d-71be-46f5-8184-09dec1aef24a
Aug 26 13:46:27 user nova-compute[73503]: INFO nova.virt.block_device [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attempting to driver detach volume a85c742d-71be-46f5-8184-09dec1aef24a from mountpoint /dev/vdb
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Attempting to detach device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:46:27 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:46:27 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:46:27 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:46:27 user nova-compute[73503]:   <serial>a85c742d-71be-46f5-8184-09dec1aef24a</serial>
Aug 26 13:46:27 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:46:27 user nova-compute[73503]: </disk>
Aug 26 13:46:27 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:46:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config.
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:46:27 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:46:27 user nova-compute[73503]:   <source dev="/dev/sdc"/>
Aug 26 13:46:27 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:46:27 user nova-compute[73503]:   <serial>a85c742d-71be-46f5-8184-09dec1aef24a</serial>
Aug 26 13:46:27 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:46:27 user nova-compute[73503]: </disk>
Aug 26 13:46:27 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057587.6261594, fe3aa281-8f42-450c-adb8-ee53d86f4279 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:46:27 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config.
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cSbBPDVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:46:27 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ce7bf-9e12-41be-9b76-fcd496799556]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f6b32e-620e-4d42-9d66-7691ebaed031]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:27 user nova-compute[73503]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a (non-flash)
Aug 26 13:46:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:27 user nova-compute[73503]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a (non-flash)
Aug 26 13:46:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd304238ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a'): ({'sdc'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Removing single pathed devices sdc {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf39d8-2eed-469f-99d2-d6015c86676e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[124d67ed-8378-4d64-9ab6-70918e16935d]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Flushing IO for device /dev/sdc {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e7340-a8f6-465c-9246-181b0c03a5c4]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62a1728-2ea8-4d50-a1a6-54de8026968c]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] SCSI volumes sdc have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e2b7e-8fef-4930-ae5f-9dbf8e3db416]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97657b6-3009-4d3a-baf0-d675a957de89]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260]
Aug 26 13:46:27 user nova-compute[73503]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a, portal: 172.16.0.220,3260] successful.
Aug 26 13:46:27 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85c742d-71be-46f5-8184-09dec1aef24a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae0cb25-0d8b-4c09-a466-071c33407298]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== disconnect_volume: return (282ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:46:27 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:46:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:28 user nova-compute[73503]: DEBUG nova.objects.instance [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:46:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-174e4fe1-60e4-4d7b-9ba6-4c0fa6636a04 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.836s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:33 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:33 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing instance network info cache due to event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated VIF entry in instance network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG nova.network.neutron [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:46:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-89dc49b3-f232-4805-ae83-621c013afe69 req-a252be34-15d7-414f-9b35-a267f1777e29 service nova] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing instance network info cache due to event network-changed-eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Refreshing network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:37 user nova-compute[73503]: INFO nova.compute.manager [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Detaching volume 18db3176-edd0-4e7c-b517-1d14df2cf508
Aug 26 13:46:37 user nova-compute[73503]: INFO nova.virt.block_device [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Attempting to driver detach volume 18db3176-edd0-4e7c-b517-1d14df2cf508 from mountpoint /dev/vdb
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Attempting to detach device vdb from instance bdde09ab-a633-4955-9202-34ffaf60f9bd from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:46:37 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:46:37 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:46:37 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:46:37 user nova-compute[73503]:   <serial>18db3176-edd0-4e7c-b517-1d14df2cf508</serial>
Aug 26 13:46:37 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:46:37 user nova-compute[73503]: </disk>
Aug 26 13:46:37 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:46:37 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully detached device vdb from instance bdde09ab-a633-4955-9202-34ffaf60f9bd from the persistent domain config.
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdde09ab-a633-4955-9202-34ffaf60f9bd from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:46:37 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:46:37 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:46:37 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:46:37 user nova-compute[73503]:   <serial>18db3176-edd0-4e7c-b517-1d14df2cf508</serial>
Aug 26 13:46:37 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:46:37 user nova-compute[73503]: </disk>
Aug 26 13:46:37 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated VIF entry in instance network info cache for port eb6dfaed-33c5-4db6-831b-ff219fad52ae. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:46:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d5e61a6f-b2ea-4f6c-9aaf-b8cffa08f4a0 req-a2c90100-3708-44ee-8735-48c11129c990 service nova] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057598.0312786, bdde09ab-a633-4955-9202-34ffaf60f9bd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:46:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully detached device vdb from instance bdde09ab-a633-4955-9202-34ffaf60f9bd from the live domain config.
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sctabVOg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:46:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eb62d0-d46f-4352-832a-63be45eb4c08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10126e1-68c9-4995-856e-7001d2d7c44a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 (non-flash)
Aug 26 13:46:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3044d32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc9f50-1181-4c4b-ace3-607eb782e9af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec73ce3-1db7-4e60-b777-f42adbd886aa]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9f5cc5-d441-43f5-9570-1562891968e7]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2efb742-9b34-4ab9-9a6b-d68ac31e78c7]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e9c535-e647-4331-a2fc-878ae381995d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[815e8ff8-f9b5-4962-b809-ce3164c282e7]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260]
Aug 26 13:46:38 user nova-compute[73503]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508, portal: 172.16.0.220,3260] successful.
Aug 26 13:46:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18db3176-edd0-4e7c-b517-1d14df2cf508 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f67fc80-458e-4710-9809-c86e675a4884]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] <== disconnect_volume: return (260ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:46:38 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:46:39 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'flavor' on Instance uuid bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:46:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8d3078de-93bd-4710-81bc-77f21ae754a5 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.667s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:39 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [{"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:46:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-bdde09ab-a633-4955-9202-34ffaf60f9bd" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:46:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:46:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:41 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:46:41 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:46:42 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:46:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=24.893333435058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bdde09ab-a633-4955-9202-34ffaf60f9bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:46:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:46:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Verify base images {{(pid=73503) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Image id 7020aec7-4750-4619-aaeb-1eb3136ee3e8 yields fingerprint 41181cf561c6e19709dd48f721d6eeed2b4f438b {{(pid=73503) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 13:46:57 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] image 7020aec7-4750-4619-aaeb-1eb3136ee3e8 at (/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b): checking
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] image 7020aec7-4750-4619-aaeb-1eb3136ee3e8 at (/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b): image is in use {{(pid=73503) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73503) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Image id bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2 yields fingerprint 67e07549493e1589014d0a2391f5c9e69597d4c7 {{(pid=73503) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 13:46:57 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] image bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2 at (/opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7): checking
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] image bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2 at (/opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7): image is in use {{(pid=73503) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] fe3aa281-8f42-450c-adb8-ee53d86f4279 is a valid instance name {{(pid=73503) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] fe3aa281-8f42-450c-adb8-ee53d86f4279 has a disk file {{(pid=73503) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 is backed by 41181cf561c6e19709dd48f721d6eeed2b4f438b {{(pid=73503) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] bdde09ab-a633-4955-9202-34ffaf60f9bd is a valid instance name {{(pid=73503) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] bdde09ab-a633-4955-9202-34ffaf60f9bd has a disk file {{(pid=73503) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 13:46:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:46:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:46:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance bdde09ab-a633-4955-9202-34ffaf60f9bd is backed by 67e07549493e1589014d0a2391f5c9e69597d4c7 {{(pid=73503) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f
Aug 26 13:46:58 user nova-compute[73503]: WARNING nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Unknown base file: /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Active base files: /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b /opt/stack/data/nova/instances/_base/67e07549493e1589014d0a2391f5c9e69597d4c7
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Removable base files: /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65 /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337 /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21 /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8edf0ee00a3e77946fb94eaaae3a39231e780c65
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f489c11b2cf5a673ccd39e17715ff94979462337
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d27692b25bc8bafa89e7440d23a73ef19893e73e
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f68106e08994af2dd8159650bdcbfdbeaf2f8caa
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/654caff845a853aa644ec7da2de2035ec5f58e9c
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/106c7ccdc1d8a365d59a19fda8a083932eee5d21
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/87e9f2792953c84d290f08ea578c81d5724b422f
Aug 26 13:46:58 user nova-compute[73503]: INFO nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/acbd386df1b58e3326b989074c5b75f2e21465a0
Aug 26 13:46:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Verification complete {{(pid=73503) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 13:46:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Verify swap images {{(pid=73503) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 13:46:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.imagecache [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Verify ephemeral images {{(pid=73503) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 13:47:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG nova.objects.instance [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:21 user nova-compute[73503]: INFO nova.compute.manager [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attaching volume 4222d4dd-471c-4eab-887c-98f61fa5c5c7 to /dev/vdb
Aug 26 13:47:21 user nova-compute[73503]: DEBUG os_brick.utils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8b861-2b94-4b45-9a8a-ad44826f31b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[41215304-8135-4e11-bfa6-8c3b2fa3a78a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f62315-cbe1-4bb8-9e56-67b6fa50d10c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ab3d9-b71e-4917-a0d9-7fc196e83c82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:47:21 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:47:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89966dc2-7e24-483e-96c0-803f3018bebf]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG os_brick.utils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:47:21 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating existing volume attachment record: d93dde13-562f-495c-ae01-228bc783d047 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:47:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:27 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:47:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NImFAjve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:47:31 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:47:31 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:47:31 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e58eca-eabe-482f-930f-74d42139233e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:47:31 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c2186-d8d6-4ae4-becb-58544d424b94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7] added
Aug 26 13:47:31 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddda1064-1ca4-41c8-9921-32c5a42733cc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c57b69a-42e0-4866-bd9b-83e11ae73326]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NImFAjve {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NImFAjve" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1587c6f0-e156-4bcd-b090-7a580fafe646]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NImFAjve'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f7e00-7770-4177-b0b6-fc26892fe3c9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2756db9-8e6e-49ba-b6e1-eed0c4d790af]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:47:31 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:47:31 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:47:31 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:47:31 user nova-compute[73503]: 
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f3fc4-9add-40eb-986c-1af90c9c484c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260]
Aug 26 13:47:31 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260] successful.
Aug 26 13:47:31 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc85eb4-df19-4577-9d61-c24aee89bc55]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce7f1ce-dd4b-40ac-83b6-67a5c8845d7e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 (non-flash)
Aug 26 13:47:31 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 (non-flash)
Aug 26 13:47:31 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd97e929-3a77-48d4-a4a7-91ab5ce75f1e]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:47:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NImFAjve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:47:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:47:32 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26532356530366432', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:47:32 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532356530366432', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:47:32 user nova-compute[73503]: DEBUG nova.objects.instance [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:47:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:47:33 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:47:33 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:47:33 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:47:33 user nova-compute[73503]:   <serial>4222d4dd-471c-4eab-887c-98f61fa5c5c7</serial>
Aug 26 13:47:33 user nova-compute[73503]: </disk>
Aug 26 13:47:33 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:47:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:47:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:47:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No VIF found with MAC fa:16:3e:c2:c0:ec, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:47:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-79534836-1932-4015-97c0-7fd1ad3b13fa tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.206s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:33 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:34 user nova-compute[73503]: INFO nova.compute.manager [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Terminating instance
Aug 26 13:47:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-0bcd00cc-538b-468e-a854-992bace84cb7 req-8f63c9b1-cbed-41f6-9475-28049ee011de service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-unplugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0bcd00cc-538b-468e-a854-992bace84cb7 req-8f63c9b1-cbed-41f6-9475-28049ee011de service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0bcd00cc-538b-468e-a854-992bace84cb7 req-8f63c9b1-cbed-41f6-9475-28049ee011de service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-0bcd00cc-538b-468e-a854-992bace84cb7 req-8f63c9b1-cbed-41f6-9475-28049ee011de service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-0bcd00cc-538b-468e-a854-992bace84cb7 req-8f63c9b1-cbed-41f6-9475-28049ee011de service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-unplugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:47:34 user nova-compute[73503]: DEBUG nova.compute.manager [req-0bcd00cc-538b-468e-a854-992bace84cb7 req-8f63c9b1-cbed-41f6-9475-28049ee011de service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-unplugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:47:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Instance destroyed successfully.
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.objects.instance [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lazy-loading 'resources' on Instance uuid bdde09ab-a633-4955-9202-34ffaf60f9bd {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1069975812',display_name='tempest-TestMinimumBasicScenario-server-1069975812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1069975812',id=50,image_ref='bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeo89sVTIOGhBTjBgcNUjUiHKLhikCuN3tiQWUBe/ompwy3QaZbC75iFeaGJs+6I4/WLZGRxDEYsJ6kh8PscLFU3VKvzwKQt7im4cqvodZnA78qjgm0E5Qa9kjm99bqwg==',key_name='tempest-TestMinimumBasicScenario-758772911',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af0839baf2914ad9a087bee16cf3e1b5',ramdisk_id='',reservation_id='r-4myzbjb1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='bdf7d946-47ce-44bc-8b7d-8c0eeed4a3a2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1890777113',owner_user_name='tempest-TestMinimumBasicScenario-1890777113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:44:52Z,user_data=None,user_id='069e5b62e5904df6bef00673c3a83f0d',uuid=bdde09ab-a633-4955-9202-34ffaf60f9bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converting VIF {"id": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "address": "fa:16:3e:c0:1e:a6", "network": {"id": "f436dbaf-e144-4f31-b43e-eab4950b967a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1961823582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0839baf2914ad9a087bee16cf3e1b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb6dfaed-33", "ovs_interfaceid": "eb6dfaed-33c5-4db6-831b-ff219fad52ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG os_vif [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb6dfaed-33, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:47:35 user nova-compute[73503]: INFO os_vif [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:1e:a6,bridge_name='br-int',has_traffic_filtering=True,id=eb6dfaed-33c5-4db6-831b-ff219fad52ae,network=Network(f436dbaf-e144-4f31-b43e-eab4950b967a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb6dfaed-33')
Aug 26 13:47:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Deleting instance files /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd_del
Aug 26 13:47:35 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Deletion of /opt/stack/data/nova/instances/bdde09ab-a633-4955-9202-34ffaf60f9bd_del complete
Aug 26 13:47:35 user nova-compute[73503]: INFO nova.compute.manager [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 13:47:35 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-d90a47c2-8edf-42b1-baaa-79926188c4e8 req-60e5c794-5954-4972-b285-3b7b5920a554 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-deleted-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:47:35 user nova-compute[73503]: INFO nova.compute.manager [req-d90a47c2-8edf-42b1-baaa-79926188c4e8 req-60e5c794-5954-4972-b285-3b7b5920a554 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Neutron deleted interface eb6dfaed-33c5-4db6-831b-ff219fad52ae; detaching it from the instance and deleting it from the info cache
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.network.neutron [req-d90a47c2-8edf-42b1-baaa-79926188c4e8 req-60e5c794-5954-4972-b285-3b7b5920a554 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:47:35 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Took 0.71 seconds to deallocate network for instance.
Aug 26 13:47:35 user nova-compute[73503]: DEBUG nova.compute.manager [req-d90a47c2-8edf-42b1-baaa-79926188c4e8 req-60e5c794-5954-4972-b285-3b7b5920a554 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Detach interface failed, port_id=eb6dfaed-33c5-4db6-831b-ff219fad52ae, reason: Instance bdde09ab-a633-4955-9202-34ffaf60f9bd could not be found. {{(pid=73503) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:36 user nova-compute[73503]: INFO nova.compute.manager [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Detaching volume 4222d4dd-471c-4eab-887c-98f61fa5c5c7
Aug 26 13:47:36 user nova-compute[73503]: INFO nova.virt.block_device [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attempting to driver detach volume 4222d4dd-471c-4eab-887c-98f61fa5c5c7 from mountpoint /dev/vdb
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Attempting to detach device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:47:36 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:47:36 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:47:36 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:47:36 user nova-compute[73503]:   <serial>4222d4dd-471c-4eab-887c-98f61fa5c5c7</serial>
Aug 26 13:47:36 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:47:36 user nova-compute[73503]: </disk>
Aug 26 13:47:36 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:47:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config.
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:47:36 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:47:36 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:47:36 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:47:36 user nova-compute[73503]:   <serial>4222d4dd-471c-4eab-887c-98f61fa5c5c7</serial>
Aug 26 13:47:36 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:47:36 user nova-compute[73503]: </disk>
Aug 26 13:47:36 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:36 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Deleted allocations for instance bdde09ab-a633-4955-9202-34ffaf60f9bd
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-2820912e-92c5-45e4-b960-11d99ccb7de2 tempest-TestMinimumBasicScenario-1890777113 tempest-TestMinimumBasicScenario-1890777113-project-member] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057656.6748312, fe3aa281-8f42-450c-adb8-ee53d86f4279 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:47:36 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config.
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NImFAjve', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:47:36 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[748400d8-56f2-4633-ac76-38bdd9f6d56d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0a386-62ce-4361-bdff-da4de99446e9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 (non-flash)
Aug 26 13:47:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 (non-flash)
Aug 26 13:47:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd314551cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5948e4f3-8d4a-4956-ab40-ef880e93c8d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2acc9f-62f6-4d26-a165-6ac7d5e81b81]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a968a-0426-4c67-82e1-e7c33f255b8d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32277474-727a-49fd-a21a-a9fe2b7c5125]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[858e1876-32be-47e8-9dc8-576e128e32e7]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-a9e8f5c5-7a9e-42d7-8c75-318939818fed req-1ed9bab3-5b57-4124-829e-1c88388ffd94 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9e8f5c5-7a9e-42d7-8c75-318939818fed req-1ed9bab3-5b57-4124-829e-1c88388ffd94 service nova] Acquiring lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9e8f5c5-7a9e-42d7-8c75-318939818fed req-1ed9bab3-5b57-4124-829e-1c88388ffd94 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-a9e8f5c5-7a9e-42d7-8c75-318939818fed req-1ed9bab3-5b57-4124-829e-1c88388ffd94 service nova] Lock "bdde09ab-a633-4955-9202-34ffaf60f9bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.compute.manager [req-a9e8f5c5-7a9e-42d7-8c75-318939818fed req-1ed9bab3-5b57-4124-829e-1c88388ffd94 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] No waiting events found dispatching network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:47:36 user nova-compute[73503]: WARNING nova.compute.manager [req-a9e8f5c5-7a9e-42d7-8c75-318939818fed req-1ed9bab3-5b57-4124-829e-1c88388ffd94 service nova] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Received unexpected event network-vif-plugged-eb6dfaed-33c5-4db6-831b-ff219fad52ae for instance with vm_state deleted and task_state None.
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0fcff4-9f45-45c7-b99f-799bc8d783c5]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260]
Aug 26 13:47:36 user nova-compute[73503]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7, portal: 172.16.0.220,3260] successful.
Aug 26 13:47:36 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4222d4dd-471c-4eab-887c-98f61fa5c5c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed774940-1337-4db5-98a6-be9b49c57ace]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== disconnect_volume: return (285ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:47:36 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:47:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:37 user nova-compute[73503]: DEBUG nova.objects.instance [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:47:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-5841f047-5edd-464b-97ce-c59e97bf710e tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.644s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:47:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:47:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:47:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:47:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:47:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:47:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:47:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:47:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:47:43 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:47:43 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=24.92013931274414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:47:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:47:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:47:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:47:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057655.1536703, bdde09ab-a633-4955-9202-34ffaf60f9bd => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:47:50 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] VM Stopped (Lifecycle Event)
Aug 26 13:47:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-2823d2fd-5e90-43bb-91f2-2625a1788c67 None None] [instance: bdde09ab-a633-4955-9202-34ffaf60f9bd] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:47:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:47:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_power_states {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:48:00 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:48:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:48:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:48:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:48:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:48:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:12 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:48:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:48:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:25 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:48:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:48:31 user nova-compute[73503]: INFO nova.compute.manager [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attaching volume 46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 to /dev/vdb
Aug 26 13:48:31 user nova-compute[73503]: DEBUG os_brick.utils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d56934-4123-4292-b164-a515d60b541b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[347ab9ad-7737-4cac-be20-386024f890c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a90035-e320-46f2-95dc-11abe3eef15b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f43985-9dce-4f23-a09f-bc958686638c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:48:31 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:48:31 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f4b849-b8b2-49c2-8eec-0439dae0088e]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG os_brick.utils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:48:31 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating existing volume attachment record: 58182b0e-08cc-4d1b-8648-3c55f05b1e43 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:48:32 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:48:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:48:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:48:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLEZDSub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:48:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:48:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:48:42 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fc70eb-ade3-4c45-b357-5356d0568cd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:48:42 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a66628-491c-42ee-b0b4-494e3ebdf411]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2] added
Aug 26 13:48:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b2e8ef-6596-4ad8-91d4-1e863fca6b97]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad3b9ad-832c-4a40-9cd3-b8688584f0ad]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLEZDSub {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLEZDSub" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28c4a7d-cfad-4f4c-9835-3d720962f228]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLEZDSub'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5033a66-d9bb-4ec4-b13c-9d221b3a45ce]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f42d67-ca08-4c8c-95ba-18dc4ecc661b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:48:42 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:48:42 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:48:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:48:42 user nova-compute[73503]: 
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a21ea2-156c-4df1-8ab5-22b461a87601]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260]
Aug 26 13:48:42 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260] successful.
Aug 26 13:48:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b443d89c-ce11-4003-9b19-e91fbf276e75]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f924c783-13b8-4e14-b19c-f2171ae979a9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 (non-flash)
Aug 26 13:48:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 (non-flash)
Aug 26 13:48:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd580b7-fec9-423e-9397-2d54d8bf9cd9]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLEZDSub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '23236363163666165', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236363163666165', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:48:43 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:48:43 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=24.958152770996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.objects.instance [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:48:43 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:48:43 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:48:43 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:48:43 user nova-compute[73503]:   <serial>46939aa9-dbcb-436c-bbd5-c21f9f1b84f2</serial>
Aug 26 13:48:43 user nova-compute[73503]: </disk>
Aug 26 13:48:43 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:48:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] No VIF found with MAC fa:16:3e:c2:c0:ec, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:48:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-9bdfb557-3e11-46d1-b88b-9e89fe4850f7 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.593s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:48:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:48:46 user nova-compute[73503]: INFO nova.compute.manager [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Detaching volume 46939aa9-dbcb-436c-bbd5-c21f9f1b84f2
Aug 26 13:48:46 user nova-compute[73503]: INFO nova.virt.block_device [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Attempting to driver detach volume 46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 from mountpoint /dev/vdb
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Attempting to detach device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:48:46 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:48:46 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:48:46 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:48:46 user nova-compute[73503]:   <serial>46939aa9-dbcb-436c-bbd5-c21f9f1b84f2</serial>
Aug 26 13:48:46 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:48:46 user nova-compute[73503]: </disk>
Aug 26 13:48:46 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:48:46 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the persistent domain config.
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:48:46 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:48:46 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:48:46 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:48:46 user nova-compute[73503]:   <serial>46939aa9-dbcb-436c-bbd5-c21f9f1b84f2</serial>
Aug 26 13:48:46 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:48:46 user nova-compute[73503]: </disk>
Aug 26 13:48:46 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693057726.6303988, fe3aa281-8f42-450c-adb8-ee53d86f4279 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:48:46 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully detached device vdb from instance fe3aa281-8f42-450c-adb8-ee53d86f4279 from the live domain config.
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLEZDSub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:48:46 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4df26a-42fc-412e-a91e-f5b1913889e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d56b2e7-e97b-45d5-9432-3b155b71feca]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 (non-flash)
Aug 26 13:48:46 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 (non-flash)
Aug 26 13:48:46 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31449dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94cdf3-1153-45ca-b066-34d1d86034cc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.033s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0408a5-0e4a-4930-b8cb-b666b8751330]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a7288b-3515-42ee-abed-0bbb95825043]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4f0ef-9109-4269-904a-e8f3f552efcf]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6473b4f8-f4c1-4948-b719-fcc2dc7a876e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e96370-462b-42d1-bd1c-40ba0e9a76b4]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260]
Aug 26 13:48:46 user nova-compute[73503]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2, portal: 172.16.0.220,3260] successful.
Aug 26 13:48:46 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46939aa9-dbcb-436c-bbd5-c21f9f1b84f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[282db7c4-cdac-44cc-b815-bfee000a5b46]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] <== disconnect_volume: return (277ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:48:46 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:48:47 user nova-compute[73503]: DEBUG nova.objects.instance [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'flavor' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:48:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-aec27be3-38af-413f-b353-c29a1f9fed6c tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:48:47 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:48:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:48:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:49:01 user nova-compute[73503]: INFO nova.compute.claims [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Claim successful on node user
Aug 26 13:49:01 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:01 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:49:02 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:49:02 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:49:02 user nova-compute[73503]: INFO nova.virt.block_device [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Booting with volume 0344bb9f-9419-4177-b877-2626a99d798a at /dev/vda
Aug 26 13:49:02 user nova-compute[73503]: DEBUG nova.policy [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55d051e3dc5048e48db1fe5f1348ebe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fcfbe6fdd2a412bb774c7f379c713a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG os_brick.utils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86025de-818c-4eda-b828-1f5e80a21c48]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3af5130-fef8-4a68-a730-7c36160e55c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ea606-78c8-4e1b-a206-ade47f758c49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c19f83d-a823-401a-9027-c41e0c61edf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:49:02 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:49:02 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b727ec-a815-4c85-8927-e3da6bc60d5f]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG os_brick.utils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating existing volume attachment record: f10ed7a1-8482-465f-bdb4-37a0bffc2a70 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:49:02 user nova-compute[73503]: DEBUG nova.network.neutron [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Successfully created port: b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Successfully updated port: b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG nova.network.neutron [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing instance network info cache due to event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:49:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG nova.network.neutron [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance network_info: |[{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated VIF entry in instance network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG nova.network.neutron [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:49:04 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-aa49f0f0-7cef-40c8-86f9-bc07e0d6b05b req-d8089ddc-4353-4ec8-adc9-53e5869ca10a service nova] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:49:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:49:12 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Creating image(s)
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Ensure instance console log exists: /opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Start _get_guest_xml network_info=[{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a78bf52c-2d59-40c7-8d82-03f766bc488f', 'attached_at': '', 'detached_at': '', 'volume_id': '0344bb9f-9419-4177-b877-2626a99d798a', 'serial': '0344bb9f-9419-4177-b877-2626a99d798a'}, 'attachment_id': 'f10ed7a1-8482-465f-bdb4-37a0bffc2a70', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:49:12 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:49:12 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:49:12 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:49:12 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:49:12 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b9c1e-72cb-4d2c-ae54-41e1ad43fdc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:49:12 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32387e54-b5bd-493a-a818-e221d8f0352a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a] added
Aug 26 13:49:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c2477-1244-492f-b328-a112fba802c3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b0415-5deb-4037-ab0e-005da7c8518a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwAfxMHS {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwAfxMHS" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b618a4-abc1-4865-9944-2463d7b2d422]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwAfxMHS'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5029729a-a257-4f88-a2ca-fde4f750701a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a36e52f-9ebb-431f-a249-d4a8a19cae49]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:49:12 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:49:12 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:49:12 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:49:12 user nova-compute[73503]: 
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f47af8c-be53-4e07-ad8d-0b30c48c4522]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]
Aug 26 13:49:12 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.
Aug 26 13:49:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e5065a-b9b7-4023-9c6c-07639f0a9eab]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[becd3fe8-80e2-4f4c-9466-3faacfb5e624]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:49:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:49:12 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0047ec93-4f40-41a5-bf95-dbbe6d985688]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:49:12 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:49:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:49:13 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23639386635663034', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:49:13 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639386635663034', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-622022323',display_name='tempest-TestShelveInstance-server-622022323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-622022323',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdLO5qVif0vnjOJ8x4rd6ghD7i4yIcFXYa103Ip/TrnwzqV8O26/6GTi6XtDWhHPHxJr5+v+LXDQPGMLf8OiCU1KuTPd9hPJBg/Qt83EU4YKOq9S2az0/qB+2EyKm4SsQ==',key_name='tempest-TestShelveInstance-715566703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcfbe6fdd2a412bb774c7f379c713a7',ramdisk_id='',reservation_id='r-2wrg7tld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1700627147',owner_user_name='tempest-TestShelveInstance-1700627147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:49:02Z,user_data=None,user_id='55d051e3dc5048e48db1fe5f1348ebe4',uuid=a78bf52c-2d59-40c7-8d82-03f766bc488f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converting VIF {"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.objects.instance [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'pci_devices' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:49:14 user nova-compute[73503]:   <uuid>a78bf52c-2d59-40c7-8d82-03f766bc488f</uuid>
Aug 26 13:49:14 user nova-compute[73503]:   <name>instance-00000034</name>
Aug 26 13:49:14 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:49:14 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:49:14 user nova-compute[73503]:   <metadata>
Aug 26 13:49:14 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:49:14 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:49:14 user nova-compute[73503]:       <nova:name>tempest-TestShelveInstance-server-622022323</nova:name>
Aug 26 13:49:14 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:49:12</nova:creationTime>
Aug 26 13:49:14 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:49:14 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:49:14 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:49:14 user nova-compute[73503]:       <nova:owner>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:user uuid="55d051e3dc5048e48db1fe5f1348ebe4">tempest-TestShelveInstance-1700627147-project-member</nova:user>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:project uuid="8fcfbe6fdd2a412bb774c7f379c713a7">tempest-TestShelveInstance-1700627147</nova:project>
Aug 26 13:49:14 user nova-compute[73503]:       </nova:owner>
Aug 26 13:49:14 user nova-compute[73503]:       <nova:ports>
Aug 26 13:49:14 user nova-compute[73503]:         <nova:port uuid="b10087d3-63a8-46cc-9cf1-b69d99756810">
Aug 26 13:49:14 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:49:14 user nova-compute[73503]:         </nova:port>
Aug 26 13:49:14 user nova-compute[73503]:       </nova:ports>
Aug 26 13:49:14 user nova-compute[73503]:     </nova:instance>
Aug 26 13:49:14 user nova-compute[73503]:   </metadata>
Aug 26 13:49:14 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:49:14 user nova-compute[73503]:     <system>
Aug 26 13:49:14 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:49:14 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:49:14 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:49:14 user nova-compute[73503]:       <entry name="serial">a78bf52c-2d59-40c7-8d82-03f766bc488f</entry>
Aug 26 13:49:14 user nova-compute[73503]:       <entry name="uuid">a78bf52c-2d59-40c7-8d82-03f766bc488f</entry>
Aug 26 13:49:14 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:49:14 user nova-compute[73503]:     </system>
Aug 26 13:49:14 user nova-compute[73503]:   </sysinfo>
Aug 26 13:49:14 user nova-compute[73503]:   <os>
Aug 26 13:49:14 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:49:14 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:49:14 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:49:14 user nova-compute[73503]:   </os>
Aug 26 13:49:14 user nova-compute[73503]:   <features>
Aug 26 13:49:14 user nova-compute[73503]:     <acpi/>
Aug 26 13:49:14 user nova-compute[73503]:     <apic/>
Aug 26 13:49:14 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:49:14 user nova-compute[73503]:   </features>
Aug 26 13:49:14 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:49:14 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:49:14 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:49:14 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:49:14 user nova-compute[73503]:   </clock>
Aug 26 13:49:14 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:49:14 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:49:14 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:49:14 user nova-compute[73503]:   </cpu>
Aug 26 13:49:14 user nova-compute[73503]:   <devices>
Aug 26 13:49:14 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:49:14 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:49:14 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:49:14 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:49:14 user nova-compute[73503]:       <serial>0344bb9f-9419-4177-b877-2626a99d798a</serial>
Aug 26 13:49:14 user nova-compute[73503]:     </disk>
Aug 26 13:49:14 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:49:14 user nova-compute[73503]:       <mac address="fa:16:3e:4c:e7:1f"/>
Aug 26 13:49:14 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:49:14 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:49:14 user nova-compute[73503]:       <target dev="tapb10087d3-63"/>
Aug 26 13:49:14 user nova-compute[73503]:     </interface>
Aug 26 13:49:14 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:49:14 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f/console.log" append="off"/>
Aug 26 13:49:14 user nova-compute[73503]:     </serial>
Aug 26 13:49:14 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:49:14 user nova-compute[73503]:     <video>
Aug 26 13:49:14 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:49:14 user nova-compute[73503]:     </video>
Aug 26 13:49:14 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:49:14 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:49:14 user nova-compute[73503]:     </rng>
Aug 26 13:49:14 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:49:14 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:49:14 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:49:14 user nova-compute[73503]:     </memballoon>
Aug 26 13:49:14 user nova-compute[73503]:   </devices>
Aug 26 13:49:14 user nova-compute[73503]: </domain>
Aug 26 13:49:14 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-622022323',display_name='tempest-TestShelveInstance-server-622022323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-622022323',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdLO5qVif0vnjOJ8x4rd6ghD7i4yIcFXYa103Ip/TrnwzqV8O26/6GTi6XtDWhHPHxJr5+v+LXDQPGMLf8OiCU1KuTPd9hPJBg/Qt83EU4YKOq9S2az0/qB+2EyKm4SsQ==',key_name='tempest-TestShelveInstance-715566703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fcfbe6fdd2a412bb774c7f379c713a7',ramdisk_id='',reservation_id='r-2wrg7tld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1700627147',owner_user_name='tempest-TestShelveInstance-1700627147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:49:02Z,user_data=None,user_id='55d051e3dc5048e48db1fe5f1348ebe4',uuid=a78bf52c-2d59-40c7-8d82-03f766bc488f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converting VIF {"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG os_vif [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb10087d3-63, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb10087d3-63, col_values=(('external_ids', {'iface-id': 'b10087d3-63a8-46cc-9cf1-b69d99756810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:e7:1f', 'vm-uuid': 'a78bf52c-2d59-40c7-8d82-03f766bc488f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:14 user nova-compute[73503]: INFO os_vif [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63')
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:49:14 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] No VIF found with MAC fa:16:3e:4c:e7:1f, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-14194c57-dff8-4a9e-87a1-d0d0b79590db req-564cef4d-a7fb-4aac-9eb4-badf9a5651ef service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14194c57-dff8-4a9e-87a1-d0d0b79590db req-564cef4d-a7fb-4aac-9eb4-badf9a5651ef service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14194c57-dff8-4a9e-87a1-d0d0b79590db req-564cef4d-a7fb-4aac-9eb4-badf9a5651ef service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-14194c57-dff8-4a9e-87a1-d0d0b79590db req-564cef4d-a7fb-4aac-9eb4-badf9a5651ef service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG nova.compute.manager [req-14194c57-dff8-4a9e-87a1-d0d0b79590db req-564cef4d-a7fb-4aac-9eb4-badf9a5651ef service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:49:15 user nova-compute[73503]: WARNING nova.compute.manager [req-14194c57-dff8-4a9e-87a1-d0d0b79590db req-564cef4d-a7fb-4aac-9eb4-badf9a5651ef service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state building and task_state spawning.
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057757.5249324, a78bf52c-2d59-40c7-8d82-03f766bc488f => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] VM Resumed (Lifecycle Event)
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance spawned successfully.
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057757.5293474, a78bf52c-2d59-40c7-8d82-03f766bc488f => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] VM Started (Lifecycle Event)
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Took 4.99 seconds to spawn the instance on the hypervisor.
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ecab369-7b56-460a-92f0-cdeace566468 req-10ed450d-f336-4f30-bb5a-6f00a61c6754 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ecab369-7b56-460a-92f0-cdeace566468 req-10ed450d-f336-4f30-bb5a-6f00a61c6754 service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ecab369-7b56-460a-92f0-cdeace566468 req-10ed450d-f336-4f30-bb5a-6f00a61c6754 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-7ecab369-7b56-460a-92f0-cdeace566468 req-10ed450d-f336-4f30-bb5a-6f00a61c6754 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:17 user nova-compute[73503]: DEBUG nova.compute.manager [req-7ecab369-7b56-460a-92f0-cdeace566468 req-10ed450d-f336-4f30-bb5a-6f00a61c6754 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:49:17 user nova-compute[73503]: WARNING nova.compute.manager [req-7ecab369-7b56-460a-92f0-cdeace566468 req-10ed450d-f336-4f30-bb5a-6f00a61c6754 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state building and task_state spawning.
Aug 26 13:49:17 user nova-compute[73503]: INFO nova.compute.manager [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Took 16.18 seconds to build instance.
Aug 26 13:49:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-850befbd-afe7-46c1-8fc5-1d6b8647e3cd tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.308s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:49:30 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:49:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:49:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [{"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:49:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-fe3aa281-8f42-450c-adb8-ee53d86f4279" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:49:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:49:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:49:45 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:49:45 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=24.94770050048828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance fe3aa281-8f42-450c-adb8-ee53d86f4279 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance a78bf52c-2d59-40c7-8d82-03f766bc488f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:49:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:49:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:48 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:49:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:49:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:49:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:50:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:50:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:50:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:50:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:50:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:50:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:23 user nova-compute[73503]: INFO nova.compute.manager [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Terminating instance
Aug 26 13:50:23 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-ed73ec9b-9e90-433b-997a-fb175076e293 req-953cabdb-35d3-4f34-8ccf-7105e82db49a service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-vif-unplugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ed73ec9b-9e90-433b-997a-fb175076e293 req-953cabdb-35d3-4f34-8ccf-7105e82db49a service nova] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ed73ec9b-9e90-433b-997a-fb175076e293 req-953cabdb-35d3-4f34-8ccf-7105e82db49a service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-ed73ec9b-9e90-433b-997a-fb175076e293 req-953cabdb-35d3-4f34-8ccf-7105e82db49a service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-ed73ec9b-9e90-433b-997a-fb175076e293 req-953cabdb-35d3-4f34-8ccf-7105e82db49a service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] No waiting events found dispatching network-vif-unplugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:50:23 user nova-compute[73503]: DEBUG nova.compute.manager [req-ed73ec9b-9e90-433b-997a-fb175076e293 req-953cabdb-35d3-4f34-8ccf-7105e82db49a service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-vif-unplugged-6232207c-8542-4457-916a-4cc128552aa8 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Instance destroyed successfully.
Aug 26 13:50:24 user nova-compute[73503]: DEBUG nova.objects.instance [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lazy-loading 'resources' on Instance uuid fe3aa281-8f42-450c-adb8-ee53d86f4279 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1870616382',display_name='tempest-SnapshotDataIntegrityTests-server-1870616382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1870616382',id=51,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIaV/PXy3JNuXU6VRbuZOZ4VZcGvQUbrQZgtbpJQMQmrXYdsFbJNLxvOLYnPjIFpRSGLnb2ltmxYxR/2W42LnscJePLJKIMOaWEasbFwWgC5kgJx3WmoVWITtY8P4mjSfA==',key_name='tempest-keypair-401450881',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57e3b29058ee42259e2e9b6495f89947',ramdisk_id='',reservation_id='r-wrwdyyzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1393965662',owner_user_name='tempest-SnapshotDataIntegrityTests-1393965662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:42:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fd8ed8aaa7740b1a64eae6248b78c3a',uuid=fe3aa281-8f42-450c-adb8-ee53d86f4279,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Converting VIF {"id": "6232207c-8542-4457-916a-4cc128552aa8", "address": "fa:16:3e:c2:c0:ec", "network": {"id": "af309d76-6a53-4cad-9753-51ff859983f2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1397454413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57e3b29058ee42259e2e9b6495f89947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6232207c-85", "ovs_interfaceid": "6232207c-8542-4457-916a-4cc128552aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG os_vif [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6232207c-85, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:24 user nova-compute[73503]: INFO os_vif [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:c0:ec,bridge_name='br-int',has_traffic_filtering=True,id=6232207c-8542-4457-916a-4cc128552aa8,network=Network(af309d76-6a53-4cad-9753-51ff859983f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6232207c-85')
Aug 26 13:50:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Deleting instance files /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279_del
Aug 26 13:50:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Deletion of /opt/stack/data/nova/instances/fe3aa281-8f42-450c-adb8-ee53d86f4279_del complete
Aug 26 13:50:24 user nova-compute[73503]: INFO nova.compute.manager [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 13:50:24 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:50:24 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:50:25 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Took 1.10 seconds to deallocate network for instance.
Aug 26 13:50:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-e52cdbfd-86b2-4657-b33d-2b3436fe9530 req-5c01efe6-412d-4994-bbff-b4ead810a335 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-vif-deleted-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:25 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Deleted allocations for instance fe3aa281-8f42-450c-adb8-ee53d86f4279
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-7421e708-c488-445f-b851-8e26e01c7019 tempest-SnapshotDataIntegrityTests-1393965662 tempest-SnapshotDataIntegrityTests-1393965662-project-member] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-d519b901-86ba-4b27-a837-3de8f8137969 req-85dbb050-a079-41e3-8fe0-c661830c8d94 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received event network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d519b901-86ba-4b27-a837-3de8f8137969 req-85dbb050-a079-41e3-8fe0-c661830c8d94 service nova] Acquiring lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d519b901-86ba-4b27-a837-3de8f8137969 req-85dbb050-a079-41e3-8fe0-c661830c8d94 service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-d519b901-86ba-4b27-a837-3de8f8137969 req-85dbb050-a079-41e3-8fe0-c661830c8d94 service nova] Lock "fe3aa281-8f42-450c-adb8-ee53d86f4279-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:25 user nova-compute[73503]: DEBUG nova.compute.manager [req-d519b901-86ba-4b27-a837-3de8f8137969 req-85dbb050-a079-41e3-8fe0-c661830c8d94 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] No waiting events found dispatching network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:50:25 user nova-compute[73503]: WARNING nova.compute.manager [req-d519b901-86ba-4b27-a837-3de8f8137969 req-85dbb050-a079-41e3-8fe0-c661830c8d94 service nova] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Received unexpected event network-vif-plugged-6232207c-8542-4457-916a-4cc128552aa8 for instance with vm_state deleted and task_state None.
Aug 26 13:50:26 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:50:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:50:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:39 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057824.159418, fe3aa281-8f42-450c-adb8-ee53d86f4279 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:50:39 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] VM Stopped (Lifecycle Event)
Aug 26 13:50:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-45717573-6556-4671-b5bc-6d93c18faeed None None] [instance: fe3aa281-8f42-450c-adb8-ee53d86f4279] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:50:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:50:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:50:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:50:40 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:50:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:50:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:50:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:50:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:50:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:50:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:50:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:50:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:45 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:50:45 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:50:46 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:50:46 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8738MB free_disk=24.974796295166016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance a78bf52c-2d59-40c7-8d82-03f766bc488f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:50:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:50 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:50:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:53 user nova-compute[73503]: DEBUG nova.compute.manager [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing instance network info cache due to event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:50:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:50:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:50:53 user nova-compute[73503]: DEBUG nova.network.neutron [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:50:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated VIF entry in instance network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG nova.network.neutron [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:54 user nova-compute[73503]: INFO nova.compute.manager [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Shelve offloading
Aug 26 13:50:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e3c2ea8a-ea8f-45c0-a47e-933a951b1ed7 req-b67b01cd-ebd3-421e-a671-803908802bfd service nova] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:54 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance destroyed successfully.
Aug 26 13:50:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:50:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:50:55 user nova-compute[73503]: WARNING nova.compute.manager [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state shelving.
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:50:55 user nova-compute[73503]: WARNING nova.compute.manager [req-69176354-0bdb-4edc-8f2a-256f94feb8f2 req-ab0afd80-9cc5-40f4-8f71-ca412759da00 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state shelving.
Aug 26 13:50:55 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance destroyed successfully.
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'resources' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-622022323',display_name='tempest-TestShelveInstance-server-622022323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-622022323',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdLO5qVif0vnjOJ8x4rd6ghD7i4yIcFXYa103Ip/TrnwzqV8O26/6GTi6XtDWhHPHxJr5+v+LXDQPGMLf8OiCU1KuTPd9hPJBg/Qt83EU4YKOq9S2az0/qB+2EyKm4SsQ==',key_name='tempest-TestShelveInstance-715566703',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcfbe6fdd2a412bb774c7f379c713a7',ramdisk_id='',reservation_id='r-2wrg7tld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1700627147',owner_user_name='tempest-TestShelveInstance-1700627147-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:49:18Z,user_data=None,user_id='55d051e3dc5048e48db1fe5f1348ebe4',uuid=a78bf52c-2d59-40c7-8d82-03f766bc488f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converting VIF {"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG os_vif [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb10087d3-63, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:50:55 user nova-compute[73503]: INFO os_vif [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63')
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.compute.manager [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing instance network info cache due to event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.network.neutron [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:50:55 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:50:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1abc42-94ac-4538-95ac-16189309769c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad420b37-128b-49ee-83ca-2062d2af8078]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:50:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:50:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30429f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ac29c3-1f4f-47b8-9fdf-8855fa8b4889]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f1fa23-13a3-4ded-b963-9cae22d8bcdb]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e3fd4-e254-4b61-8e8f-69362d69e337]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[206f164d-6f53-4bde-ae3c-be16446dd2c8]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d187b-09a8-4dd3-a8bb-f5921357bcbe]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[065e9ef9-22cd-45d1-8446-9b0d9afb97ae]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]
Aug 26 13:50:56 user nova-compute[73503]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.
Aug 26 13:50:56 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eeb3c8-ade3-4d47-9911-c0cacac0e2d3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.534s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] <== disconnect_volume: return (536ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:50:56 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Deleting instance files /opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f_del
Aug 26 13:50:56 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Deletion of /opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f_del complete
Aug 26 13:50:56 user nova-compute[73503]: DEBUG nova.network.neutron [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated VIF entry in instance network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG nova.network.neutron [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": null, "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb10087d3-63", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:50:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-c1fb0684-ceb6-475c-b666-d0d85eb979c7 req-efaeae52-0b9f-44b6-947c-711cd2ac42e8 service nova] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:50:57 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Deleted allocations for instance a78bf52c-2d59-40c7-8d82-03f766bc488f
Aug 26 13:50:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG nova.objects.instance [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'numa_topology' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG nova.objects.base [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Object Instance<a78bf52c-2d59-40c7-8d82-03f766bc488f> lazy-loaded attributes: resources,numa_topology {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.087s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-1053a6fc-d496-475b-b1f3-746c58ceaa98 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.603s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:50:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:09 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693057854.7783089, a78bf52c-2d59-40c7-8d82-03f766bc488f => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:51:09 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] VM Stopped (Lifecycle Event)
Aug 26 13:51:09 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b68ba683-e159-4829-8088-68ddb86167c4 None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:51:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:51:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:51:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:51:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:51:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:51:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:21 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:27 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:31 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:51:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:51:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:51:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:51:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:51:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:51:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:51:47 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:51:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:51:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:51:47 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:51:48 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:51:48 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:51:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.97311782836914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:51:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:51:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:51:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:51:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:51:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:51:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:51:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:51:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:29 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:52:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:52:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:52:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:32 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:52:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:52:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:52:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:52:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:52:45 user nova-compute[73503]: INFO nova.compute.manager [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Unshelving
Aug 26 13:52:45 user nova-compute[73503]: INFO nova.virt.block_device [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Booting with volume 0344bb9f-9419-4177-b877-2626a99d798a at /dev/vda
Aug 26 13:52:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:52:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG os_brick.utils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fce2807-e852-404f-b0ed-10556f9c6153]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a934ba5d-6f26-4dbe-93bb-41d2f29de39d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcdf319-6698-4735-b85d-7675efaaebca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9394fc71-8e2b-441e-97fe-1b67ce9acc6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:52:46 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:52:46 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa94763-2653-462f-b59f-2edbc0954e28]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG os_brick.utils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:52:46 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating existing volume attachment record: 42ca2fe4-f362-437a-a026-b04783f9c082 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:52:47 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:52:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:52:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:52:47 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:52:48 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:52:48 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.972496032714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance a78bf52c-2d59-40c7-8d82-03f766bc488f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:52:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:52:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:51 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:52:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:52:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:52:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'pci_requests' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'numa_topology' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:52:56 user nova-compute[73503]: INFO nova.compute.claims [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Claim successful on node user
Aug 26 13:52:56 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:52:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:52:56 user nova-compute[73503]: INFO nova.network.neutron [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating port b10087d3-63a8-46cc-9cf1-b69d99756810 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 13:52:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.compute.manager [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing instance network info cache due to event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.network.neutron [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:52:58 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Creating image(s)
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Did not create local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Ensure instance console log exists: /opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Start _get_guest_xml network_info=[{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a78bf52c-2d59-40c7-8d82-03f766bc488f', 'attached_at': '', 'detached_at': '', 'volume_id': '0344bb9f-9419-4177-b877-2626a99d798a', 'serial': '0344bb9f-9419-4177-b877-2626a99d798a'}, 'attachment_id': '42ca2fe4-f362-437a-a026-b04783f9c082', 'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:52:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:52:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.objects.instance [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'vcpu_model' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.objects.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Object Instance<a78bf52c-2d59-40c7-8d82-03f766bc488f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:52:58 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:52:58 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:52:58 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b8f492-e6f1-4cb0-8ca2-e99bd41276c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:52:58 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ffd35-7cbc-4c3d-8e47-7a1b4d51c8f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a] added
Aug 26 13:52:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc8827a-f210-41db-a502-324d9cdbc4ad]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edd87f9-0c35-4c46-acf6-90104e1ed397]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwAfxMHS {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwAfxMHS" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[228e58d9-eb91-440c-8c9e-7b47e11c099d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwAfxMHS'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804cbfc-b8b6-44a4-ac1f-16033b106139]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ed65e-fde8-4dc6-a5e5-549284790ea9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:52:58 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:52:58 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:52:58 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:52:58 user nova-compute[73503]: 
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0722f1-077b-48a7-8e37-5f737c918630]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]
Aug 26 13:52:58 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.
Aug 26 13:52:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3355293b-2afe-45cf-8640-265d78086407]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc916b00-2e94-448d-ae77-27c04409b216]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:52:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:52:58 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ce23dd-b618-40eb-a21a-95ece6b760fb]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated VIF entry in instance network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:52:58 user nova-compute[73503]: DEBUG nova.network.neutron [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-29a04d36-62e0-49d9-89be-c8c4778d14bc req-5e505a36-55d8-445b-a6d7-8899e70a9231 service nova] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23639386635663034', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639386635663034', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-622022323',display_name='tempest-TestShelveInstance-server-622022323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-622022323',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-715566703',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8fcfbe6fdd2a412bb774c7f379c713a7',ramdisk_id='',reservation_id='r-2wrg7tld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1700627147',owner_user_name='tempest-TestShelveInstance-1700627147-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:52:46Z,user_data=None,user_id='55d051e3dc5048e48db1fe5f1348ebe4',uuid=a78bf52c-2d59-40c7-8d82-03f766bc488f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converting VIF {"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.objects.instance [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'pci_devices' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.objects.base [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Object Instance<a78bf52c-2d59-40c7-8d82-03f766bc488f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73503) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:52:59 user nova-compute[73503]:   <uuid>a78bf52c-2d59-40c7-8d82-03f766bc488f</uuid>
Aug 26 13:52:59 user nova-compute[73503]:   <name>instance-00000034</name>
Aug 26 13:52:59 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:52:59 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:52:59 user nova-compute[73503]:   <metadata>
Aug 26 13:52:59 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:52:59 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:52:59 user nova-compute[73503]:       <nova:name>tempest-TestShelveInstance-server-622022323</nova:name>
Aug 26 13:52:59 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:52:58</nova:creationTime>
Aug 26 13:52:59 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:52:59 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:52:59 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:52:59 user nova-compute[73503]:       <nova:owner>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:user uuid="55d051e3dc5048e48db1fe5f1348ebe4">tempest-TestShelveInstance-1700627147-project-member</nova:user>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:project uuid="8fcfbe6fdd2a412bb774c7f379c713a7">tempest-TestShelveInstance-1700627147</nova:project>
Aug 26 13:52:59 user nova-compute[73503]:       </nova:owner>
Aug 26 13:52:59 user nova-compute[73503]:       <nova:ports>
Aug 26 13:52:59 user nova-compute[73503]:         <nova:port uuid="b10087d3-63a8-46cc-9cf1-b69d99756810">
Aug 26 13:52:59 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 13:52:59 user nova-compute[73503]:         </nova:port>
Aug 26 13:52:59 user nova-compute[73503]:       </nova:ports>
Aug 26 13:52:59 user nova-compute[73503]:     </nova:instance>
Aug 26 13:52:59 user nova-compute[73503]:   </metadata>
Aug 26 13:52:59 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:52:59 user nova-compute[73503]:     <system>
Aug 26 13:52:59 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:52:59 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:52:59 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:52:59 user nova-compute[73503]:       <entry name="serial">a78bf52c-2d59-40c7-8d82-03f766bc488f</entry>
Aug 26 13:52:59 user nova-compute[73503]:       <entry name="uuid">a78bf52c-2d59-40c7-8d82-03f766bc488f</entry>
Aug 26 13:52:59 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:52:59 user nova-compute[73503]:     </system>
Aug 26 13:52:59 user nova-compute[73503]:   </sysinfo>
Aug 26 13:52:59 user nova-compute[73503]:   <os>
Aug 26 13:52:59 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:52:59 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:52:59 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:52:59 user nova-compute[73503]:   </os>
Aug 26 13:52:59 user nova-compute[73503]:   <features>
Aug 26 13:52:59 user nova-compute[73503]:     <acpi/>
Aug 26 13:52:59 user nova-compute[73503]:     <apic/>
Aug 26 13:52:59 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:52:59 user nova-compute[73503]:   </features>
Aug 26 13:52:59 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:52:59 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:52:59 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:52:59 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:52:59 user nova-compute[73503]:   </clock>
Aug 26 13:52:59 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:52:59 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:52:59 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:52:59 user nova-compute[73503]:   </cpu>
Aug 26 13:52:59 user nova-compute[73503]:   <devices>
Aug 26 13:52:59 user nova-compute[73503]:     <disk type="block" device="disk">
Aug 26 13:52:59 user nova-compute[73503]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:52:59 user nova-compute[73503]:       <source dev="/dev/sdb"/>
Aug 26 13:52:59 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:52:59 user nova-compute[73503]:       <serial>0344bb9f-9419-4177-b877-2626a99d798a</serial>
Aug 26 13:52:59 user nova-compute[73503]:     </disk>
Aug 26 13:52:59 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:52:59 user nova-compute[73503]:       <mac address="fa:16:3e:4c:e7:1f"/>
Aug 26 13:52:59 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:52:59 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:52:59 user nova-compute[73503]:       <target dev="tapb10087d3-63"/>
Aug 26 13:52:59 user nova-compute[73503]:     </interface>
Aug 26 13:52:59 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:52:59 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f/console.log" append="off"/>
Aug 26 13:52:59 user nova-compute[73503]:     </serial>
Aug 26 13:52:59 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:52:59 user nova-compute[73503]:     <video>
Aug 26 13:52:59 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:52:59 user nova-compute[73503]:     </video>
Aug 26 13:52:59 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:52:59 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:52:59 user nova-compute[73503]:     </rng>
Aug 26 13:52:59 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:52:59 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:52:59 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:52:59 user nova-compute[73503]:     </memballoon>
Aug 26 13:52:59 user nova-compute[73503]:   </devices>
Aug 26 13:52:59 user nova-compute[73503]: </domain>
Aug 26 13:52:59 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-622022323',display_name='tempest-TestShelveInstance-server-622022323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-622022323',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-715566703',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:49:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8fcfbe6fdd2a412bb774c7f379c713a7',ramdisk_id='',reservation_id='r-2wrg7tld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1700627147',owner_user_name='tempest-TestShelveInstance-1700627147-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:52:46Z,user_data=None,user_id='55d051e3dc5048e48db1fe5f1348ebe4',uuid=a78bf52c-2d59-40c7-8d82-03f766bc488f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converting VIF {"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG os_vif [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb10087d3-63, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb10087d3-63, col_values=(('external_ids', {'iface-id': 'b10087d3-63a8-46cc-9cf1-b69d99756810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:e7:1f', 'vm-uuid': 'a78bf52c-2d59-40c7-8d82-03f766bc488f'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:52:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:52:59 user nova-compute[73503]: INFO os_vif [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63')
Aug 26 13:53:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:53:00 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] No VIF found with MAC fa:16:3e:4c:e7:1f, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-68ac6643-d324-4381-9c38-4f54c269a9e9 req-1e4961db-bb9a-450b-a9c5-0ae969f971bc service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-68ac6643-d324-4381-9c38-4f54c269a9e9 req-1e4961db-bb9a-450b-a9c5-0ae969f971bc service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-68ac6643-d324-4381-9c38-4f54c269a9e9 req-1e4961db-bb9a-450b-a9c5-0ae969f971bc service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-68ac6643-d324-4381-9c38-4f54c269a9e9 req-1e4961db-bb9a-450b-a9c5-0ae969f971bc service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG nova.compute.manager [req-68ac6643-d324-4381-9c38-4f54c269a9e9 req-1e4961db-bb9a-450b-a9c5-0ae969f971bc service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:53:01 user nova-compute[73503]: WARNING nova.compute.manager [req-68ac6643-d324-4381-9c38-4f54c269a9e9 req-1e4961db-bb9a-450b-a9c5-0ae969f971bc service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 13:53:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:01 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057983.4605865, a78bf52c-2d59-40c7-8d82-03f766bc488f => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:53:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] VM Resumed (Lifecycle Event)
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:53:03 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance spawned successfully.
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:53:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693057983.4647927, a78bf52c-2d59-40c7-8d82-03f766bc488f => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:53:03 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] VM Started (Lifecycle Event)
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-453bb282-85c6-432e-9482-f5eaa7adde5e tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.769s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-b30fc948-0f41-4eba-8fc2-f1db8ecd17a1 req-8a313d60-b03e-419c-bb41-1b10d96dd331 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b30fc948-0f41-4eba-8fc2-f1db8ecd17a1 req-8a313d60-b03e-419c-bb41-1b10d96dd331 service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b30fc948-0f41-4eba-8fc2-f1db8ecd17a1 req-8a313d60-b03e-419c-bb41-1b10d96dd331 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-b30fc948-0f41-4eba-8fc2-f1db8ecd17a1 req-8a313d60-b03e-419c-bb41-1b10d96dd331 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [req-b30fc948-0f41-4eba-8fc2-f1db8ecd17a1 req-8a313d60-b03e-419c-bb41-1b10d96dd331 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:53:03 user nova-compute[73503]: WARNING nova.compute.manager [req-b30fc948-0f41-4eba-8fc2-f1db8ecd17a1 req-8a313d60-b03e-419c-bb41-1b10d96dd331 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state None.
Aug 26 13:53:03 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:53:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:53:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:53:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:53:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:53:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:53:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:53:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:31 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:34 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:53:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:53:41 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:53:42 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:53:42 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:53:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:53:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:53:48 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:53:49 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:53:49 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=24.971019744873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance a78bf52c-2d59-40c7-8d82-03f766bc488f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:53:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:53:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:53:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:53:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:53:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:53:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:53:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:53:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:54:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:54:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:54:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:54:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:54:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:54:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:32 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:33 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing instance network info cache due to event network-changed-b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] Acquiring lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] Acquired lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.network.neutron [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Refreshing network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:37 user nova-compute[73503]: INFO nova.compute.manager [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Terminating instance
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-08e2c48d-1ef0-4aed-8882-7ab7554f9546 req-6b109475-6324-4f65-8c89-c118fa2f6dd2 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-08e2c48d-1ef0-4aed-8882-7ab7554f9546 req-6b109475-6324-4f65-8c89-c118fa2f6dd2 service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-08e2c48d-1ef0-4aed-8882-7ab7554f9546 req-6b109475-6324-4f65-8c89-c118fa2f6dd2 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-08e2c48d-1ef0-4aed-8882-7ab7554f9546 req-6b109475-6324-4f65-8c89-c118fa2f6dd2 service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-08e2c48d-1ef0-4aed-8882-7ab7554f9546 req-6b109475-6324-4f65-8c89-c118fa2f6dd2 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:54:37 user nova-compute[73503]: DEBUG nova.compute.manager [req-08e2c48d-1ef0-4aed-8882-7ab7554f9546 req-6b109475-6324-4f65-8c89-c118fa2f6dd2 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updated VIF entry in instance network info cache for port b10087d3-63a8-46cc-9cf1-b69d99756810. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.network.neutron [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [{"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-48c5b08c-f846-4c3f-97e8-4d0de7d6b2a7 req-95e483b3-f506-4d97-b32c-c8164e55496b service nova] Releasing lock "refresh_cache-a78bf52c-2d59-40c7-8d82-03f766bc488f" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Instance destroyed successfully.
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.objects.instance [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lazy-loading 'resources' on Instance uuid a78bf52c-2d59-40c7-8d82-03f766bc488f {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T13:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-622022323',display_name='tempest-TestShelveInstance-server-622022323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-622022323',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdLO5qVif0vnjOJ8x4rd6ghD7i4yIcFXYa103Ip/TrnwzqV8O26/6GTi6XtDWhHPHxJr5+v+LXDQPGMLf8OiCU1KuTPd9hPJBg/Qt83EU4YKOq9S2az0/qB+2EyKm4SsQ==',key_name='tempest-TestShelveInstance-715566703',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:53:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fcfbe6fdd2a412bb774c7f379c713a7',ramdisk_id='',reservation_id='r-2wrg7tld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1700627147',owner_user_name='tempest-TestShelveInstance-1700627147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:53:04Z,user_data=None,user_id='55d051e3dc5048e48db1fe5f1348ebe4',uuid=a78bf52c-2d59-40c7-8d82-03f766bc488f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converting VIF {"id": "b10087d3-63a8-46cc-9cf1-b69d99756810", "address": "fa:16:3e:4c:e7:1f", "network": {"id": "4a8d2d0e-9060-42d2-a3c8-2ee662aada68", "bridge": "br-int", "label": "tempest-TestShelveInstance-2102369365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fcfbe6fdd2a412bb774c7f379c713a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb10087d3-63", "ovs_interfaceid": "b10087d3-63a8-46cc-9cf1-b69d99756810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_vif [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb10087d3-63, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:38 user nova-compute[73503]: INFO os_vif [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e7:1f,bridge_name='br-int',has_traffic_filtering=True,id=b10087d3-63a8-46cc-9cf1-b69d99756810,network=Network(4a8d2d0e-9060-42d2-a3c8-2ee662aada68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb10087d3-63')
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwAfxMHS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:54:38 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7729c2-1965-47c6-84a0-4ad0f1d7fd35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e42c59-3506-45a4-bcae-3f197f26ac6e]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:54:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a (non-flash)
Aug 26 13:54:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3145b7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921bbae-d83c-40f5-b169-a513abec9a9f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b660e4-9668-4fd1-9fe5-b530c1f848e2]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c95b2b-168b-427c-87c8-84408e605649]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d34098-53b2-49d7-a2f3-e12da666aead]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7ef29a03-698f5f04595b5042', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ef29a03', '/dev/disk/by-id/scsi-23639386635663034') {{(pid=84865) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[704fa089-6e3e-411d-bff3-aa30fd1da14b]: (4, None) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab9e26-28db-41a5-a0aa-92c60c1f6763]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[39084379-168c-418c-853f-ada5104194f1]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260]
Aug 26 13:54:38 user nova-compute[73503]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a, portal: 172.16.0.220,3260] successful.
Aug 26 13:54:38 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0344bb9f-9419-4177-b877-2626a99d798a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e14d66-43e1-4143-b08e-a65975c44087]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] <== disconnect_volume: return (296ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:54:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Deleting instance files /opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f_del
Aug 26 13:54:38 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Deletion of /opt/stack/data/nova/instances/a78bf52c-2d59-40c7-8d82-03f766bc488f_del complete
Aug 26 13:54:38 user nova-compute[73503]: INFO nova.compute.manager [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 13:54:38 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:54:39 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Took 0.55 seconds to deallocate network for instance.
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-1baed0d5-0069-4798-98b0-8b4ece78768e req-38cd4292-fff1-4ddc-a02e-c05ca8f0e9b6 service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-deleted-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:54:39 user nova-compute[73503]: WARNING nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state deleting.
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:54:39 user nova-compute[73503]: WARNING nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state deleting.
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:54:39 user nova-compute[73503]: WARNING nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state deleting.
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-unplugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Acquiring lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:39 user nova-compute[73503]: DEBUG nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] No waiting events found dispatching network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:54:39 user nova-compute[73503]: WARNING nova.compute.manager [req-fe316aa5-b1da-4480-befc-de761f3f86c2 req-a543274c-6331-491f-94ae-46235559a46f service nova] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Received unexpected event network-vif-plugged-b10087d3-63a8-46cc-9cf1-b69d99756810 for instance with vm_state active and task_state deleting.
Aug 26 13:54:40 user nova-compute[73503]: INFO nova.compute.manager [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 13:54:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Deleting volume: 0344bb9f-9419-4177-b877-2626a99d798a {{(pid=73503) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 13:54:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:40 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:54:40 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:54:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:40 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Deleted allocations for instance a78bf52c-2d59-40c7-8d82-03f766bc488f
Aug 26 13:54:40 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-0be3753d-e78e-4878-bb3c-70910e053bb5 tempest-TestShelveInstance-1700627147 tempest-TestShelveInstance-1700627147-project-member] Lock "a78bf52c-2d59-40c7-8d82-03f766bc488f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:54:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:54:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:54:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:54:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:54:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:54:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:54:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:54:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:54:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:54:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=24.970096588134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:54:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:54:53 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693058078.321054, a78bf52c-2d59-40c7-8d82-03f766bc488f => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:54:53 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] VM Stopped (Lifecycle Event)
Aug 26 13:54:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d15fd231-46b1-4e31-a590-8f01d741ec7d None None] [instance: a78bf52c-2d59-40c7-8d82-03f766bc488f] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:54:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:54:54 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:54:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:55:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:55:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:55:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:55:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:55:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:31 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:34 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:37 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:55:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:55:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:55:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 13:55:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:55:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:55:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:55:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:55:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:55:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:55:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:55:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:55:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:55:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.97774887084961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:55:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:55:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:55 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:55:57 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:55:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:02 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:03 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:07 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:16 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Starting instance... {{(pid=73503) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73503) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 13:56:22 user nova-compute[73503]: INFO nova.compute.claims [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Claim successful on node user
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Start building networks asynchronously for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Allocating IP information in the background. {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] allocate_for_instance() {{(pid=73503) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 13:56:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Start building block device mappings for instance. {{(pid=73503) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.policy [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c6b585570d24f098392a9e6ad5c40eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f67ed141764e6798c832a55e6170f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73503) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Start spawning the instance on the hypervisor. {{(pid=73503) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Creating instance directory {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 13:56:22 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Creating image(s)
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "/opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "/opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "/opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.211s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:22 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk 1073741824 {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b,backing_fmt=raw /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk 1073741824" returned: 0 in 0.057s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "41181cf561c6e19709dd48f721d6eeed2b4f438b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41181cf561c6e19709dd48f721d6eeed2b4f438b --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk. size=1073741824 {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Successfully created port: 11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG nova.virt.disk.api [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Cannot resize image /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk to a smaller size. {{(pid=73503) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Created local disks {{(pid=73503) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Ensure instance console log exists: /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/console.log {{(pid=73503) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Successfully updated port: 11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Building network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-changed-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.compute.manager [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Refreshing instance network info cache due to event network-changed-11083374-5562-44d2-9886-db24905585a8. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Instance cache missing network info. {{(pid=73503) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Instance network_info: |[{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73503) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.neutron [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Refreshing network info cache for port 11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Start _get_guest_xml network_info=[{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'device_name': '/dev/vda', 'encrypted': False, 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'image_id': '7020aec7-4750-4619-aaeb-1eb3136ee3e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 13:56:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:56:24 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CPU controller missing on host. {{(pid=73503) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.host [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CPU controller found on host. {{(pid=73503) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73503) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T13:07:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T13:07:27Z,direct_url=<?>,disk_format='qcow2',id=7020aec7-4750-4619-aaeb-1eb3136ee3e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='6e791872642e435180feefd03ef1d9af',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T13:07:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Flavor limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Image limits 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Flavor pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Image pref 0:0:0 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Got 1 possible topologies {{(pid=73503) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.hardware [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73503) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-151901096',display_name='tempest-SnapshotDataIntegrityTests-server-151901096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-151901096',id=53,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED7DwmavNrhoYiDF8Zd5dlEHOLeJpLSdnXXLI57IPqNSuRdgKXEnoIcrdDqPfPEkyIYiwmNpWQ72aETSuAv/2n4intbD/7Vl8fVW8fxGP+blo9Z49gdBffMxnyvGFrC4Q==',key_name='tempest-keypair-567244862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42f67ed141764e6798c832a55e6170f3',ramdisk_id='',reservation_id='r-cos51xns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1029203926',owner_user_name='tempest-SnapshotDataIntegrityTests-1029203926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:56:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6b585570d24f098392a9e6ad5c40eb',uuid=c079af38-ab5f-4aea-96fd-7a7164fd1b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73503) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Converting VIF {"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'pci_devices' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] End _get_guest_xml xml=<domain type="kvm">
Aug 26 13:56:24 user nova-compute[73503]:   <uuid>c079af38-ab5f-4aea-96fd-7a7164fd1b13</uuid>
Aug 26 13:56:24 user nova-compute[73503]:   <name>instance-00000035</name>
Aug 26 13:56:24 user nova-compute[73503]:   <memory>524288</memory>
Aug 26 13:56:24 user nova-compute[73503]:   <vcpu>1</vcpu>
Aug 26 13:56:24 user nova-compute[73503]:   <metadata>
Aug 26 13:56:24 user nova-compute[73503]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 13:56:24 user nova-compute[73503]:       <nova:package version="0.0.0"/>
Aug 26 13:56:24 user nova-compute[73503]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-151901096</nova:name>
Aug 26 13:56:24 user nova-compute[73503]:       <nova:creationTime>2023-08-26 13:56:24</nova:creationTime>
Aug 26 13:56:24 user nova-compute[73503]:       <nova:flavor name="m1.tiny">
Aug 26 13:56:24 user nova-compute[73503]:         <nova:memory>512</nova:memory>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:disk>1</nova:disk>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:swap>0</nova:swap>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:vcpus>1</nova:vcpus>
Aug 26 13:56:24 user nova-compute[73503]:       </nova:flavor>
Aug 26 13:56:24 user nova-compute[73503]:       <nova:owner>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:user uuid="1c6b585570d24f098392a9e6ad5c40eb">tempest-SnapshotDataIntegrityTests-1029203926-project-member</nova:user>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:project uuid="42f67ed141764e6798c832a55e6170f3">tempest-SnapshotDataIntegrityTests-1029203926</nova:project>
Aug 26 13:56:24 user nova-compute[73503]:       </nova:owner>
Aug 26 13:56:24 user nova-compute[73503]:       <nova:root type="image" uuid="7020aec7-4750-4619-aaeb-1eb3136ee3e8"/>
Aug 26 13:56:24 user nova-compute[73503]:       <nova:ports>
Aug 26 13:56:24 user nova-compute[73503]:         <nova:port uuid="11083374-5562-44d2-9886-db24905585a8">
Aug 26 13:56:24 user nova-compute[73503]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 13:56:24 user nova-compute[73503]:         </nova:port>
Aug 26 13:56:24 user nova-compute[73503]:       </nova:ports>
Aug 26 13:56:24 user nova-compute[73503]:     </nova:instance>
Aug 26 13:56:24 user nova-compute[73503]:   </metadata>
Aug 26 13:56:24 user nova-compute[73503]:   <sysinfo type="smbios">
Aug 26 13:56:24 user nova-compute[73503]:     <system>
Aug 26 13:56:24 user nova-compute[73503]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 13:56:24 user nova-compute[73503]:       <entry name="product">OpenStack Nova</entry>
Aug 26 13:56:24 user nova-compute[73503]:       <entry name="version">0.0.0</entry>
Aug 26 13:56:24 user nova-compute[73503]:       <entry name="serial">c079af38-ab5f-4aea-96fd-7a7164fd1b13</entry>
Aug 26 13:56:24 user nova-compute[73503]:       <entry name="uuid">c079af38-ab5f-4aea-96fd-7a7164fd1b13</entry>
Aug 26 13:56:24 user nova-compute[73503]:       <entry name="family">Virtual Machine</entry>
Aug 26 13:56:24 user nova-compute[73503]:     </system>
Aug 26 13:56:24 user nova-compute[73503]:   </sysinfo>
Aug 26 13:56:24 user nova-compute[73503]:   <os>
Aug 26 13:56:24 user nova-compute[73503]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 13:56:24 user nova-compute[73503]:     <boot dev="hd"/>
Aug 26 13:56:24 user nova-compute[73503]:     <smbios mode="sysinfo"/>
Aug 26 13:56:24 user nova-compute[73503]:   </os>
Aug 26 13:56:24 user nova-compute[73503]:   <features>
Aug 26 13:56:24 user nova-compute[73503]:     <acpi/>
Aug 26 13:56:24 user nova-compute[73503]:     <apic/>
Aug 26 13:56:24 user nova-compute[73503]:     <vmcoreinfo/>
Aug 26 13:56:24 user nova-compute[73503]:   </features>
Aug 26 13:56:24 user nova-compute[73503]:   <clock offset="utc">
Aug 26 13:56:24 user nova-compute[73503]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 13:56:24 user nova-compute[73503]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 13:56:24 user nova-compute[73503]:     <timer name="hpet" present="no"/>
Aug 26 13:56:24 user nova-compute[73503]:   </clock>
Aug 26 13:56:24 user nova-compute[73503]:   <cpu mode="custom" match="exact">
Aug 26 13:56:24 user nova-compute[73503]:     <model>Nehalem</model>
Aug 26 13:56:24 user nova-compute[73503]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 13:56:24 user nova-compute[73503]:   </cpu>
Aug 26 13:56:24 user nova-compute[73503]:   <devices>
Aug 26 13:56:24 user nova-compute[73503]:     <disk type="file" device="disk">
Aug 26 13:56:24 user nova-compute[73503]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 13:56:24 user nova-compute[73503]:       <source file="/opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk"/>
Aug 26 13:56:24 user nova-compute[73503]:       <target dev="vda" bus="virtio"/>
Aug 26 13:56:24 user nova-compute[73503]:     </disk>
Aug 26 13:56:24 user nova-compute[73503]:     <interface type="ethernet">
Aug 26 13:56:24 user nova-compute[73503]:       <mac address="fa:16:3e:16:90:c8"/>
Aug 26 13:56:24 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:56:24 user nova-compute[73503]:       <mtu size="1442"/>
Aug 26 13:56:24 user nova-compute[73503]:       <target dev="tap11083374-55"/>
Aug 26 13:56:24 user nova-compute[73503]:     </interface>
Aug 26 13:56:24 user nova-compute[73503]:     <serial type="pty">
Aug 26 13:56:24 user nova-compute[73503]:       <log file="/opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/console.log" append="off"/>
Aug 26 13:56:24 user nova-compute[73503]:     </serial>
Aug 26 13:56:24 user nova-compute[73503]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 13:56:24 user nova-compute[73503]:     <video>
Aug 26 13:56:24 user nova-compute[73503]:       <model type="virtio"/>
Aug 26 13:56:24 user nova-compute[73503]:     </video>
Aug 26 13:56:24 user nova-compute[73503]:     <rng model="virtio">
Aug 26 13:56:24 user nova-compute[73503]:       <backend model="random">/dev/urandom</backend>
Aug 26 13:56:24 user nova-compute[73503]:     </rng>
Aug 26 13:56:24 user nova-compute[73503]:     <controller type="usb" index="0" model="none"/>
Aug 26 13:56:24 user nova-compute[73503]:     <memballoon model="virtio">
Aug 26 13:56:24 user nova-compute[73503]:       <stats period="10"/>
Aug 26 13:56:24 user nova-compute[73503]:     </memballoon>
Aug 26 13:56:24 user nova-compute[73503]:   </devices>
Aug 26 13:56:24 user nova-compute[73503]: </domain>
Aug 26 13:56:24 user nova-compute[73503]:  {{(pid=73503) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-151901096',display_name='tempest-SnapshotDataIntegrityTests-server-151901096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-151901096',id=53,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED7DwmavNrhoYiDF8Zd5dlEHOLeJpLSdnXXLI57IPqNSuRdgKXEnoIcrdDqPfPEkyIYiwmNpWQ72aETSuAv/2n4intbD/7Vl8fVW8fxGP+blo9Z49gdBffMxnyvGFrC4Q==',key_name='tempest-keypair-567244862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42f67ed141764e6798c832a55e6170f3',ramdisk_id='',reservation_id='r-cos51xns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1029203926',owner_user_name='tempest-SnapshotDataIntegrityTests-1029203926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T13:56:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6b585570d24f098392a9e6ad5c40eb',uuid=c079af38-ab5f-4aea-96fd-7a7164fd1b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Converting VIF {"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG os_vif [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55') {{(pid=73503) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11083374-55, may_exist=True, interface_attrs={}) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11083374-55, col_values=(('external_ids', {'iface-id': '11083374-5562-44d2-9886-db24905585a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:90:c8', 'vm-uuid': 'c079af38-ab5f-4aea-96fd-7a7164fd1b13'}),), if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:56:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:24 user nova-compute[73503]: INFO os_vif [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55')
Aug 26 13:56:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:56:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No VIF found with MAC fa:16:3e:16:90:c8, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:56:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated VIF entry in instance network info cache for port 11083374-5562-44d2-9886-db24905585a8. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:56:25 user nova-compute[73503]: DEBUG nova.network.neutron [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:56:25 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-8b02db82-8e20-488a-afda-19d33ca261fe req-429488d6-91f3-4886-a1b6-5626d8d33bcd service nova] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-5a22f164-3ea0-4259-aec4-cdca4eae48ae req-77d5d3e6-1e00-4617-b919-7c668772427d service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5a22f164-3ea0-4259-aec4-cdca4eae48ae req-77d5d3e6-1e00-4617-b919-7c668772427d service nova] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5a22f164-3ea0-4259-aec4-cdca4eae48ae req-77d5d3e6-1e00-4617-b919-7c668772427d service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-5a22f164-3ea0-4259-aec4-cdca4eae48ae req-77d5d3e6-1e00-4617-b919-7c668772427d service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:26 user nova-compute[73503]: DEBUG nova.compute.manager [req-5a22f164-3ea0-4259-aec4-cdca4eae48ae req-77d5d3e6-1e00-4617-b919-7c668772427d service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] No waiting events found dispatching network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:56:26 user nova-compute[73503]: WARNING nova.compute.manager [req-5a22f164-3ea0-4259-aec4-cdca4eae48ae req-77d5d3e6-1e00-4617-b919-7c668772427d service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received unexpected event network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 for instance with vm_state building and task_state spawning.
Aug 26 13:56:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:27 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-e0a02870-08fb-42a4-b60c-59d901f7c24a req-c2abaefc-c152-4d05-a9c5-5971f03ba0d7 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e0a02870-08fb-42a4-b60c-59d901f7c24a req-c2abaefc-c152-4d05-a9c5-5971f03ba0d7 service nova] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e0a02870-08fb-42a4-b60c-59d901f7c24a req-c2abaefc-c152-4d05-a9c5-5971f03ba0d7 service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-e0a02870-08fb-42a4-b60c-59d901f7c24a req-c2abaefc-c152-4d05-a9c5-5971f03ba0d7 service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.compute.manager [req-e0a02870-08fb-42a4-b60c-59d901f7c24a req-c2abaefc-c152-4d05-a9c5-5971f03ba0d7 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] No waiting events found dispatching network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 13:56:28 user nova-compute[73503]: WARNING nova.compute.manager [req-e0a02870-08fb-42a4-b60c-59d901f7c24a req-c2abaefc-c152-4d05-a9c5-5971f03ba0d7 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received unexpected event network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 for instance with vm_state building and task_state spawning.
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693058188.950788, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => Resumed> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:56:28 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] VM Resumed (Lifecycle Event)
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Instance event wait completed in 0 seconds for  {{(pid=73503) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Guest created on hypervisor {{(pid=73503) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 13:56:28 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Instance spawned successfully.
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Found default for hw_cdrom_bus of ide {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Found default for hw_disk_bus of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Found default for hw_input_bus of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Found default for hw_pointer_model of None {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Found default for hw_video_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Found default for hw_vif_model of virtio {{(pid=73503) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:56:28 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:56:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:56:29 user nova-compute[73503]: DEBUG nova.virt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Emitting event <LifecycleEvent: 1693058188.952523, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => Started> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 13:56:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] VM Started (Lifecycle Event)
Aug 26 13:56:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:56:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73503) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 13:56:29 user nova-compute[73503]: INFO nova.compute.manager [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 13:56:29 user nova-compute[73503]: INFO nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 26 13:56:29 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 13:56:29 user nova-compute[73503]: INFO nova.compute.manager [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Took 7.12 seconds to build instance.
Aug 26 13:56:29 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d300fe16-529c-498a-bb9f-aae7a454f499 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.435s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:56:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:56:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:56:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:56:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:56:38 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:43 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:56:46 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:56:47 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:56:47 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:56:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:56:47 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:56:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:56:50 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=24.927230834960938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:56:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:56:53 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:56 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:56:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:56:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:09 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:57:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:57:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:57:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:24 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:29 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:34 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:35 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:36 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:57:39 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:44 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:47 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:57:47 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:57:48 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:57:51 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:57:52 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:57:52 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=24.92282485961914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 13:57:52 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 13:57:53 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:57:53 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:57:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:57:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:57:53 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:54 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:57:55 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:56 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:57:59 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:04 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:58:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:11 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:11 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 13:58:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-changed-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 13:58:12 user nova-compute[73503]: DEBUG nova.compute.manager [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Refreshing instance network info cache due to event network-changed-11083374-5562-44d2-9886-db24905585a8. {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 13:58:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:58:12 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:58:12 user nova-compute[73503]: DEBUG nova.network.neutron [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Refreshing network info cache for port 11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 13:58:13 user nova-compute[73503]: DEBUG nova.network.neutron [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated VIF entry in instance network info cache for port 11083374-5562-44d2-9886-db24905585a8. {{(pid=73503) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 13:58:13 user nova-compute[73503]: DEBUG nova.network.neutron [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:58:13 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-62eecc02-44d8-4f1f-b7aa-74d4c8a4fe43 req-16d2a4c0-e69c-4906-bbe8-14e48b18cfe1 service nova] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:58:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG nova.objects.instance [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:58:18 user nova-compute[73503]: INFO nova.compute.manager [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attaching volume 8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 to /dev/vdb
Aug 26 13:58:18 user nova-compute[73503]: DEBUG os_brick.utils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcfcf52-7e48-4698-b9c8-6c13d9f055bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[763bd3c9-576b-433f-b485-f9bedfe813d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38a2c67-b078-4948-8af3-ddf81d071cc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d213d6-717c-439e-85eb-09f63e943b7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 13:58:18 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 13:58:18 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad91e55-e0a7-4da7-88ad-9e03db68dadc]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG os_brick.utils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating existing volume attachment record: 4504aa9c-687c-49d1-9784-dc2c77009c11 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 13:58:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:24 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_power_states {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:24 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Triggering sync for uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 13:58:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:58:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:58:37 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 13:58:38 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:58:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPCRwDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:58:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:58:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:58:42 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c7b5da-256e-4a14-b62f-9d3c33fc6ca2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 13:58:42 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f149802-14e9-4890-884e-af53906cb6aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081] added
Aug 26 13:58:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c72bb-1333-4b5e-8ad4-ac18011481bb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5366e-cde6-4872-843a-153401dc05dc]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfPCRwDb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfPCRwDb" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678e4f0-dfcf-45c0-b1c2-5b0b9facc7fb]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tfPCRwDb'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[736deb21-6212-40c9-9b75-830e870ab72b]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a6e98-8f89-4422-87c1-4d60bb357fb2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:58:42 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 13:58:42 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:58:42 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 13:58:42 user nova-compute[73503]: 
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e77fdc2-0aac-4998-9cd3-f35a6daa429d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260]
Aug 26 13:58:42 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260] successful.
Aug 26 13:58:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1f2f4-1970-4f7d-b8c0-f7af098d33f1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd4009-4751-4743-991c-a9730f6a37ec]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 (non-flash)
Aug 26 13:58:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 (non-flash)
Aug 26 13:58:42 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255c174-86dd-46fb-a237-39a40a7f4a6e]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:58:42 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPCRwDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23235656639366336', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235656639366336', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG nova.objects.instance [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 13:58:43 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:58:43 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:58:43 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:58:43 user nova-compute[73503]:   <serial>8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081</serial>
Aug 26 13:58:43 user nova-compute[73503]: </disk>
Aug 26 13:58:43 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 13:58:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No VIF found with MAC fa:16:3e:16:90:c8, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 13:58:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-eb071dcd-15cb-4e25-9e98-ccb62257950f tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.693s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:58:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.574s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:58:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:58:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:46 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:58:48 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:58:49 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:58:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:58:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:58:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:49 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:52 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73503) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 13:58:53 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:58:53 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=24.912944793701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:58:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:58:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:58:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:58:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:58:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:58:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:58:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:58:58 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:08 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:59:16 user nova-compute[73503]: INFO nova.compute.manager [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Detaching volume 8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081
Aug 26 13:59:16 user nova-compute[73503]: INFO nova.virt.block_device [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attempting to driver detach volume 8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 from mountpoint /dev/vdb
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Attempting to detach device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:59:16 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:59:16 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:59:16 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:59:16 user nova-compute[73503]:   <serial>8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081</serial>
Aug 26 13:59:16 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:59:16 user nova-compute[73503]: </disk>
Aug 26 13:59:16 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:59:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config.
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 13:59:16 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 13:59:16 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 13:59:16 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 13:59:16 user nova-compute[73503]:   <serial>8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081</serial>
Aug 26 13:59:16 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 13:59:16 user nova-compute[73503]: </disk>
Aug 26 13:59:16 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693058356.6628985, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 13:59:16 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config.
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfPCRwDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 13:59:16 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b54d44-cb88-4faf-83b8-79c1e061fdae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a341bd5-369a-4c67-96ba-e99a12499969]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 (non-flash)
Aug 26 13:59:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 (non-flash)
Aug 26 13:59:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd30436f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f8ff9-1856-4e61-a07d-7c86d21c1977]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac05bbcd-5145-4af4-a62a-4c284dacd4eb]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b46dd7-316f-4ddd-a17b-b2bc7c1e6e84]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d79239c-5e8d-4070-a570-3ba8d2efc1d5]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5377d585-610f-431e-b652-66bc08961dd1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[86588f76-f4da-4ed0-bbec-f8f073ae4198]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260]
Aug 26 13:59:16 user nova-compute[73503]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081, portal: 172.16.0.220,3260] successful.
Aug 26 13:59:16 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ff0ab8a-6b2d-4a79-a233-c87a9e4d6081 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afb0753-3969-44df-b917-278a71b6fe88]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== disconnect_volume: return (274ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 13:59:16 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 13:59:17 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:59:17 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8039974e-a598-45fb-b041-97a6618ae671 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.722s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:59:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:59:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:59:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:59:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:38 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:40 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 13:59:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:48 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 13:59:49 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 13:59:50 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:53 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 13:59:54 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:59:54 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=24.912044525146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 13:59:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 13:59:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 13:59:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 13:59:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:00:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG nova.objects.instance [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:00:10 user nova-compute[73503]: INFO nova.compute.manager [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attaching volume e9810985-bdd7-436c-8e8c-b7d2295460c3 to /dev/vdb
Aug 26 14:00:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bafc94-031c-4e59-87b4-d0ea957cad42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1591c7-463a-4813-8bab-13dda7c93063]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d65887-67b3-47da-85e6-757d07680396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b547f3-bb86-4f17-8c4d-1735fc671509]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:00:10 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:00:10 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93420cc-f66f-44f9-9716-b9e4df55e23b]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG os_brick.utils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:00:10 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating existing volume attachment record: cb26d0b8-ac0b-4cef-b320-5c5a5c41933b {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:00:13 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMsirEFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:00:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:00:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:00:21 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e35593-d172-4a6e-8765-ef7bb0919837]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:00:21 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea697fa-c47d-4fad-8b19-5fccd7f4b83d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3] added
Aug 26 14:00:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81fbe2-be12-4c11-9d23-98bc857ca65d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[448c155e-ace6-49f4-9386-92a4fbefe192]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMsirEFc {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pMsirEFc" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c059f54-38f8-49e6-92c9-106feb160cb7]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pMsirEFc'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d147096c-704b-4aeb-99a3-c4687626f05c]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d123da0-1fb2-490e-9d11-d85053f96970]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:00:21 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:00:21 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:00:21 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:00:21 user nova-compute[73503]: 
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec060e0d-f8b2-4712-83fe-438768ba1ab2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260]
Aug 26 14:00:21 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260] successful.
Aug 26 14:00:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc03406-5676-4835-a754-cdad9e8ef9ae]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72304c39-0aaf-4349-9ea8-d57d84aefab7]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 (non-flash)
Aug 26 14:00:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 (non-flash)
Aug 26 14:00:21 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e3aa5-4603-4140-bd2b-41d092cae3b6]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:21 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMsirEFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23834633432383265', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834633432383265', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG nova.objects.instance [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:00:22 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:00:22 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:00:22 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:00:22 user nova-compute[73503]:   <serial>e9810985-bdd7-436c-8e8c-b7d2295460c3</serial>
Aug 26 14:00:22 user nova-compute[73503]: </disk>
Aug 26 14:00:22 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No VIF found with MAC fa:16:3e:16:90:c8, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:00:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-da8b30dd-8350-4927-9ae8-627a46ddd1c5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.451s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:00:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:00:24 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:00:24 user nova-compute[73503]: INFO nova.compute.manager [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Detaching volume e9810985-bdd7-436c-8e8c-b7d2295460c3
Aug 26 14:00:24 user nova-compute[73503]: INFO nova.virt.block_device [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attempting to driver detach volume e9810985-bdd7-436c-8e8c-b7d2295460c3 from mountpoint /dev/vdb
Aug 26 14:00:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Attempting to detach device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:00:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:00:24 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:00:24 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:00:24 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:00:24 user nova-compute[73503]:   <serial>e9810985-bdd7-436c-8e8c-b7d2295460c3</serial>
Aug 26 14:00:24 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:00:24 user nova-compute[73503]: </disk>
Aug 26 14:00:24 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:00:24 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config.
Aug 26 14:00:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:00:24 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:00:24 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:00:24 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:00:24 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:00:24 user nova-compute[73503]:   <serial>e9810985-bdd7-436c-8e8c-b7d2295460c3</serial>
Aug 26 14:00:24 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:00:24 user nova-compute[73503]: </disk>
Aug 26 14:00:24 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693058425.3914118, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:00:25 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config.
Aug 26 14:00:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pMsirEFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:00:25 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a14547-1f93-4ba3-b00e-85eebc975f96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3697c88-75ed-4819-b28b-3d7df5f34208]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 (non-flash)
Aug 26 14:00:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 (non-flash)
Aug 26 14:00:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3145b5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0ffd4-3cee-49c7-ba79-bd12a0708ecc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[31346850-024d-4794-af0f-71010e743bbb]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee05175f-e36f-4e32-9dc3-9af44a5a0ff6]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17ed3b3-275c-4f00-ac7e-33e1d82028cf]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[13194e0b-ff16-483f-9995-726f5e8a95b0]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3db3e3-ec67-4d6e-97b0-b334f7011aad]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260]
Aug 26 14:00:25 user nova-compute[73503]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3, portal: 172.16.0.220,3260] successful.
Aug 26 14:00:25 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9810985-bdd7-436c-8e8c-b7d2295460c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[371e92d6-cf6d-47dd-afb7-2d8b1d4d24e1]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== disconnect_volume: return (252ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:00:25 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:00:26 user nova-compute[73503]: DEBUG nova.objects.instance [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:00:26 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-74000621-5b1f-4041-8950-a0551fcb4326 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:00:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:40 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:42 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:00:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:00:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:00:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:00:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:00:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:49 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:00:50 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:00:51 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:00:51 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:00:51 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:00:51 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:55 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:00:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:00:56 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.91100311279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:00:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:00:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:01:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:01:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:01:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:18 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG nova.objects.instance [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:01:19 user nova-compute[73503]: INFO nova.compute.manager [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attaching volume 7f268845-21b4-40e9-a204-5c162035b3a4 to /dev/vdb
Aug 26 14:01:19 user nova-compute[73503]: DEBUG os_brick.utils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8254ffe-aa0a-439f-a1e1-fed901d9151a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dce4f80-30ca-4083-bdde-e457fea4551b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d1886-7bfb-4e00-9bdf-1e8ffa3f1e45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc88f989-0588-4654-afb1-9cb16fa50b61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:01:19 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:01:19 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86fc12-5dc3-4aec-8b20-c9174dbb6813]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG os_brick.utils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:01:19 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating existing volume attachment record: 4986f787-65df-477a-a71f-48e7c81d1767 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:01:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:23 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXnfMRFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:01:29 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:01:29 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:01:29 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14b1b0-ad39-4700-8e5d-eb0d8ca7cbde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:01:29 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9909100-9340-43e6-af59-629f46d8295f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4] added
Aug 26 14:01:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6817e9f-89a6-4185-a739-d50abc9c4de2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[67770743-ea66-4178-a965-454b8345e259]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dXnfMRFH {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dXnfMRFH" returned: 0 in 0.022s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b45cbb3-df14-4adf-b971-a10cffa44474]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dXnfMRFH'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f5aa30-9901-412d-9731-6c7ba0c0f17e]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fcbad2-0b3c-4914-80d2-57e2a71730a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:01:29 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:01:29 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:01:29 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:01:29 user nova-compute[73503]: 
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[101dd882-8ab4-40cd-8fe7-ba62bcfc9fa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260]
Aug 26 14:01:29 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260] successful.
Aug 26 14:01:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[627353e1-2a83-4a6d-83ef-bc851091b648]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2b032-ea2b-4093-a60a-1e75510db4dd]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 (non-flash)
Aug 26 14:01:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 (non-flash)
Aug 26 14:01:29 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a614cf-64b8-478d-aa5e-452010706396]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:01:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXnfMRFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:01:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:30 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:01:30 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23438396466663964', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:01:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438396466663964', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:01:30 user nova-compute[73503]: DEBUG nova.objects.instance [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:01:30 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:01:30 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:01:30 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:01:30 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:01:30 user nova-compute[73503]:   <serial>7f268845-21b4-40e9-a204-5c162035b3a4</serial>
Aug 26 14:01:30 user nova-compute[73503]: </disk>
Aug 26 14:01:30 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:01:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:01:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:01:31 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No VIF found with MAC fa:16:3e:16:90:c8, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:01:31 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-76295362-e1cc-419b-8ca2-44ba97941fc5 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.955s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:01:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:01:33 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:01:33 user nova-compute[73503]: INFO nova.compute.manager [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Detaching volume 7f268845-21b4-40e9-a204-5c162035b3a4
Aug 26 14:01:33 user nova-compute[73503]: INFO nova.virt.block_device [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attempting to driver detach volume 7f268845-21b4-40e9-a204-5c162035b3a4 from mountpoint /dev/vdb
Aug 26 14:01:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Attempting to detach device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:01:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:01:33 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:01:33 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:01:33 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:01:33 user nova-compute[73503]:   <serial>7f268845-21b4-40e9-a204-5c162035b3a4</serial>
Aug 26 14:01:33 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:01:33 user nova-compute[73503]: </disk>
Aug 26 14:01:33 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:01:33 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config.
Aug 26 14:01:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:01:33 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:01:33 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:01:33 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:01:33 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:01:33 user nova-compute[73503]:   <serial>7f268845-21b4-40e9-a204-5c162035b3a4</serial>
Aug 26 14:01:33 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:01:33 user nova-compute[73503]: </disk>
Aug 26 14:01:33 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:01:33 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693058494.1337986, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:01:34 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config.
Aug 26 14:01:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXnfMRFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:01:34 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[985da6bb-3f2c-4f30-bca1-78d29f90d568]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[329fa11a-1010-4d11-8d2c-666e60624fe4]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 (non-flash)
Aug 26 14:01:34 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 (non-flash)
Aug 26 14:01:34 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd31ef89630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c90d87-ea84-43df-95d3-a0eca89818cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d13db1-1bd3-45d8-8069-244a9fb15b37]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f74ab36-0964-4d84-9918-baf44c352c25]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[faff1b5a-6699-432b-883a-206ba2dad12e]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3145dde-7a00-4921-8987-6ef83ff934f2]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0487029-41e3-42b1-95c4-027f36831e6c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260]
Aug 26 14:01:34 user nova-compute[73503]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4, portal: 172.16.0.220,3260] successful.
Aug 26 14:01:34 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f268845-21b4-40e9-a204-5c162035b3a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cb3608-8649-44d5-a864-106b3741e3b9]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.234s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== disconnect_volume: return (234ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:01:34 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:01:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:35 user nova-compute[73503]: DEBUG nova.objects.instance [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:01:35 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-4dd2b84a-a018-43d1-ab0c-73fdda96a7c7 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:01:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:44 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:44 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:01:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:01:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:50 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:01:52 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:01:53 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:01:53 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:01:53 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:01:53 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:01:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:01:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=24.91000747680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:01:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:01:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:01:59 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:02:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:02:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:02:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:02:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:02:27 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:02:27 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:02:28 user nova-compute[73503]: INFO nova.compute.manager [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attaching volume 20ecfd92-0490-45b9-bb89-2e05ce1c588d to /dev/vdb
Aug 26 14:02:28 user nova-compute[73503]: DEBUG os_brick.utils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff8487-7f23-4d6f-9985-6c9d9a6a961f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c99135ce547a\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9372fdc-960e-4ab2-bf9a-4b712e4da5ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c25643-5566-4621-8b80-abe97e73f283]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b8306b-0e42-40bb-bff8-69057aa0c530]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:28 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Running cmd (subprocess): nvme version {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] 'nvme version' failed. Not Retrying. {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] nvme not present on system {{(pid=73503) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 14:02:29 user nova-compute[73503]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 14:02:29 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee820b3-b5cc-4337-99be-29af22038a0e]: (4, '') {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73503) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.lightos [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] LIGHTOS: no hostnqn found. {{(pid=73503) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG os_brick.utils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c99135ce547a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:02:29 user nova-compute[73503]: DEBUG nova.virt.block_device [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating existing volume attachment record: b3ce2ad8-8f23-4420-b274-18ebd0d1f948 {{(pid=73503) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 14:02:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Calling os-brick to attach iSCSI Volume {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'orbQSZiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:02:39 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:02:39 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:02:39 user nova-compute[73503]: INFO os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d870949e-9a9e-47ac-991c-9ccc52f41582]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 14:02:39 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --interface default --op new {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43786b6-2a53-475d-a5f0-8a1eaec20e44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d] added\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d] added
Aug 26 14:02:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3eff283-e4a2-4bde-b075-abf033869c92]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe0350-e21f-42fd-b326-9cc7427c9423]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v orbQSZiD {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v orbQSZiD" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[362ba7c7-b70f-4852-88cb-59ed8a0ee66d]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'orbQSZiD'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7272efe-5596-4344-b8f5-4817ad202494]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb040b6-59b0-441f-a493-c311e7e425c8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:02:39 user nova-compute[73503]:  {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 14:02:39 user nova-compute[73503]:  {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:02:39 user nova-compute[73503]: WARNING os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 14:02:39 user nova-compute[73503]: 
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --login {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c0595-3771-4ad4-bf1e-5b4f9aedf7fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260]
Aug 26 14:02:39 user nova-compute[73503]: Login to [iface: default, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260] successful.
Aug 26 14:02:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af5a9c-9b1d-4bd1-9937-b286ef9f65a3]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[538cbf8c-3484-45ab-bca6-6de616520acf]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d (non-flash)
Aug 26 14:02:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d (non-flash)
Aug 26 14:02:39 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to 172.16.0.220:3260 {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73503) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73503) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e751a2-79d8-4efd-971c-65c07fe72b42]: (4, ('- - 0', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73503) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 14:02:39 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'orbQSZiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73503) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23866643232306262', 'path': '/dev/sdb'} {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866643232306262', 'path': '/dev/sdb'} {{(pid=73503) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG nova.objects.instance [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 14:02:40 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:02:40 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:02:40 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:02:40 user nova-compute[73503]:   <serial>20ecfd92-0490-45b9-bb89-2e05ce1c588d</serial>
Aug 26 14:02:40 user nova-compute[73503]: </disk>
Aug 26 14:02:40 user nova-compute[73503]:  {{(pid=73503) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vda, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73503) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 14:02:40 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] No VIF found with MAC fa:16:3e:16:90:c8, not building metadata {{(pid=73503) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 14:02:41 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-8072bd36-872a-4b26-99b1-332029ec1dc1 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.146s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:02:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:02:43 user nova-compute[73503]: INFO nova.compute.manager [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Detaching volume 20ecfd92-0490-45b9-bb89-2e05ce1c588d
Aug 26 14:02:43 user nova-compute[73503]: INFO nova.virt.block_device [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Attempting to driver detach volume 20ecfd92-0490-45b9-bb89-2e05ce1c588d from mountpoint /dev/vdb
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Attempting to detach device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config. {{(pid=73503) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:02:43 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:02:43 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:02:43 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:02:43 user nova-compute[73503]:   <serial>20ecfd92-0490-45b9-bb89-2e05ce1c588d</serial>
Aug 26 14:02:43 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:02:43 user nova-compute[73503]: </disk>
Aug 26 14:02:43 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:02:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the persistent domain config.
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config. {{(pid=73503) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.guest [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 14:02:43 user nova-compute[73503]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 14:02:43 user nova-compute[73503]:   <source dev="/dev/sdb"/>
Aug 26 14:02:43 user nova-compute[73503]:   <target dev="vdb" bus="virtio"/>
Aug 26 14:02:43 user nova-compute[73503]:   <serial>20ecfd92-0490-45b9-bb89-2e05ce1c588d</serial>
Aug 26 14:02:43 user nova-compute[73503]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 14:02:43 user nova-compute[73503]: </disk>
Aug 26 14:02:43 user nova-compute[73503]:  {{(pid=73503) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-b426b8a2-31ba-4fae-8ffd-b232f2142f6d None None] Received event <DeviceRemovedEvent: 1693058563.741342, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73503) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.driver [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 14:02:43 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully detached device vdb from instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 from the live domain config.
Aug 26 14:02:43 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] calling os-brick to detach iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd3140e5f60>, {'target_iqns': ['iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'orbQSZiD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 14:02:43 user nova-compute[73503]: WARNING os_brick.initiator.connectors.base [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d', 0)] {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f70aa19-e130-4993-a54a-c890a50d71ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c141a-0271-4a19-b6cc-9a4b6c8281b9]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d (non-flash)\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d (non-flash)
Aug 26 14:02:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d (non-flash)
Aug 26 14:02:43 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd3218f4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d'): ({'sdb'}, set())}) {{(pid=73503) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Removing single pathed devices sdb {{(pid=73503) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06ccc8a-b6ea-4744-9a45-1a39a025854b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20d0b80-b7f0-46bc-b57e-d48af64c39fb]: (4, ('ok\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Flushing IO for device /dev/sdb {{(pid=73503) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[285eaa4c-beec-49a4-8119-a192ecc4a857]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73503) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a7d996-db1c-47c9-a317-827fe930658d]: (4, ('1', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.linuxscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] SCSI volumes sdb have been removed. {{(pid=73503) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d')] {{(pid=73503) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b6317e-67d0-4f24-996f-d0cf63a0582a]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:43 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --logout {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --logout" returned: 0 in 0.234s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edf2172-ce9c-433c-b374-bfb0a5d2f685]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260]
Aug 26 14:02:44 user nova-compute[73503]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d, portal: 172.16.0.220,3260] successful.
Aug 26 14:02:44 user nova-compute[73503]:  stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op delete {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ecfd92-0490-45b9-bb89-2e05ce1c588d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84865) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547b817-0030-4834-be25-442f9d663285]: (4, ('', '')) {{(pid=84865) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73503) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.base [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] <== disconnect_volume: return (455ms) None {{(pid=73503) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Disconnected iSCSI Volume {{(pid=73503) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG nova.objects.instance [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'flavor' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:02:44 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-c1bf9a37-6589-4120-abfa-961aaa89ae70 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:02:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:45 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:02:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:02:50 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:02:54 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:02:55 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:56 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:02:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:02:57 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=24.909011840820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing inventories for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating ProviderTree inventory for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Updating inventory in ProviderTree for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing aggregate associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, aggregates: None {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Refreshing trait associations for resource provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73503) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:02:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:03:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:00 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:04 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:03:19 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances with incomplete migration  {{(pid=73503) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 14:03:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:03:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:03:39 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Cleaning up deleted instances {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 14:03:39 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] There are 0 instances to clean {{(pid=73503) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 14:03:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:43 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:03:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:03:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:03:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:03:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:46 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:03:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:03:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:03:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:03:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:03:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:03:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquired lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Forcefully refreshing network info cache for instance {{(pid=73503) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 14:03:56 user nova-compute[73503]: DEBUG nova.objects.instance [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lazy-loading 'info_cache' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG nova.network.neutron [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [{"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Releasing lock "refresh_cache-c079af38-ab5f-4aea-96fd-7a7164fd1b13" {{(pid=73503) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updated the network info_cache for instance {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:03:57 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG oslo_concurrency.processutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73503) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 14:03:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:03:58 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.908191680908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Instance c079af38-ab5f-4aea-96fd-7a7164fd1b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73503) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:03:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:00 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:02 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:19 user nova-compute[73503]: INFO nova.compute.manager [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Terminating instance
Aug 26 14:04:19 user nova-compute[73503]: DEBUG nova.compute.manager [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Start destroying the instance on the hypervisor. {{(pid=73503) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:19 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-2fa09d50-5407-4194-96dc-339631b61253 req-404bef14-9bc1-45c0-b574-583b09fcfd2b service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-vif-unplugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2fa09d50-5407-4194-96dc-339631b61253 req-404bef14-9bc1-45c0-b574-583b09fcfd2b service nova] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2fa09d50-5407-4194-96dc-339631b61253 req-404bef14-9bc1-45c0-b574-583b09fcfd2b service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-2fa09d50-5407-4194-96dc-339631b61253 req-404bef14-9bc1-45c0-b574-583b09fcfd2b service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-2fa09d50-5407-4194-96dc-339631b61253 req-404bef14-9bc1-45c0-b574-583b09fcfd2b service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] No waiting events found dispatching network-vif-unplugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.compute.manager [req-2fa09d50-5407-4194-96dc-339631b61253 req-404bef14-9bc1-45c0-b574-583b09fcfd2b service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-vif-unplugged-11083374-5562-44d2-9886-db24905585a8 for instance with task_state deleting. {{(pid=73503) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Instance destroyed successfully.
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.objects.instance [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lazy-loading 'resources' on Instance uuid c079af38-ab5f-4aea-96fd-7a7164fd1b13 {{(pid=73503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.virt.libvirt.vif [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T13:56:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-151901096',display_name='tempest-SnapshotDataIntegrityTests-server-151901096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-151901096',id=53,image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED7DwmavNrhoYiDF8Zd5dlEHOLeJpLSdnXXLI57IPqNSuRdgKXEnoIcrdDqPfPEkyIYiwmNpWQ72aETSuAv/2n4intbD/7Vl8fVW8fxGP+blo9Z49gdBffMxnyvGFrC4Q==',key_name='tempest-keypair-567244862',keypairs=<?>,launch_index=0,launched_at=2023-08-26T13:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42f67ed141764e6798c832a55e6170f3',ramdisk_id='',reservation_id='r-cos51xns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7020aec7-4750-4619-aaeb-1eb3136ee3e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1029203926',owner_user_name='tempest-SnapshotDataIntegrityTests-1029203926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T13:56:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c6b585570d24f098392a9e6ad5c40eb',uuid=c079af38-ab5f-4aea-96fd-7a7164fd1b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Converting VIF {"id": "11083374-5562-44d2-9886-db24905585a8", "address": "fa:16:3e:16:90:c8", "network": {"id": "ea01c746-88f9-4300-9473-e255fdb17284", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-265783416-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42f67ed141764e6798c832a55e6170f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11083374-55", "ovs_interfaceid": "11083374-5562-44d2-9886-db24905585a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.network.os_vif_util [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55') {{(pid=73503) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG os_vif [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55') {{(pid=73503) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11083374-55, bridge=br-int, if_exists=True) {{(pid=73503) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:20 user nova-compute[73503]: INFO os_vif [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:90:c8,bridge_name='br-int',has_traffic_filtering=True,id=11083374-5562-44d2-9886-db24905585a8,network=Network(ea01c746-88f9-4300-9473-e255fdb17284),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11083374-55')
Aug 26 14:04:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Deleting instance files /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13_del
Aug 26 14:04:20 user nova-compute[73503]: INFO nova.virt.libvirt.driver [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Deletion of /opt/stack/data/nova/instances/c079af38-ab5f-4aea-96fd-7a7164fd1b13_del complete
Aug 26 14:04:20 user nova-compute[73503]: INFO nova.compute.manager [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 14:04:20 user nova-compute[73503]: DEBUG oslo.service.loopingcall [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73503) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.compute.manager [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Deallocating network for instance {{(pid=73503) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 14:04:20 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] deallocate_for_instance() {{(pid=73503) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 14:04:21 user nova-compute[73503]: DEBUG nova.network.neutron [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Updating instance_info_cache with network_info: [] {{(pid=73503) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 14:04:21 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Took 0.89 seconds to deallocate network for instance.
Aug 26 14:04:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:21 user nova-compute[73503]: DEBUG nova.compute.manager [req-0711e1b1-8e00-4951-8d2e-ff7d0596fec0 req-eeb09049-279a-470d-95e6-03090563613d service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-vif-deleted-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:04:21 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:04:21 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:04:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:21 user nova-compute[73503]: INFO nova.scheduler.client.report [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Deleted allocations for instance c079af38-ab5f-4aea-96fd-7a7164fd1b13
Aug 26 14:04:21 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-6d5282ef-9dc1-4a28-859b-22e884e9c289 tempest-SnapshotDataIntegrityTests-1029203926 tempest-SnapshotDataIntegrityTests-1029203926-project-member] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-6baf2185-028f-4185-8b12-de12658ecb32 req-18410869-405c-4b4b-89b7-6ccc55e322a1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received event network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 14:04:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6baf2185-028f-4185-8b12-de12658ecb32 req-18410869-405c-4b4b-89b7-6ccc55e322a1 service nova] Acquiring lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6baf2185-028f-4185-8b12-de12658ecb32 req-18410869-405c-4b4b-89b7-6ccc55e322a1 service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:22 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [req-6baf2185-028f-4185-8b12-de12658ecb32 req-18410869-405c-4b4b-89b7-6ccc55e322a1 service nova] Lock "c079af38-ab5f-4aea-96fd-7a7164fd1b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:22 user nova-compute[73503]: DEBUG nova.compute.manager [req-6baf2185-028f-4185-8b12-de12658ecb32 req-18410869-405c-4b4b-89b7-6ccc55e322a1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] No waiting events found dispatching network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 {{(pid=73503) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 14:04:22 user nova-compute[73503]: WARNING nova.compute.manager [req-6baf2185-028f-4185-8b12-de12658ecb32 req-18410869-405c-4b4b-89b7-6ccc55e322a1 service nova] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Received unexpected event network-vif-plugged-11083374-5562-44d2-9886-db24905585a8 for instance with vm_state deleted and task_state None.
Aug 26 14:04:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:35 user nova-compute[73503]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693058660.4785907, c079af38-ab5f-4aea-96fd-7a7164fd1b13 => Stopped> {{(pid=73503) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 14:04:35 user nova-compute[73503]: INFO nova.compute.manager [-] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] VM Stopped (Lifecycle Event)
Aug 26 14:04:35 user nova-compute[73503]: DEBUG nova.compute.manager [None req-7ee362e5-d449-4500-9495-49f609ce245b None None] [instance: c079af38-ab5f-4aea-96fd-7a7164fd1b13] Checking state {{(pid=73503) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 14:04:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:04:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:04:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:04:40 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:41 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:42 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:45 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:04:45 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:46 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:46 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73503) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 14:04:50 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:52 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:54 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:55 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:04:57 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Starting heal instance info cache {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 14:04:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Rebuilding the list of instances to heal {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 14:04:57 user nova-compute[73503]: DEBUG nova.compute.manager [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Didn't find any instances for network info cache update. {{(pid=73503) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 14:04:58 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager.update_available_resource {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:04:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:58 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:04:58 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Auditing locally available compute resources for user (node: user) {{(pid=73503) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 14:04:59 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:04:59 user nova-compute[73503]: WARNING nova.virt.libvirt.driver [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 14:04:59 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.935516357421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73503) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73503) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG nova.compute.provider_tree [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed in ProviderTree for provider: 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 {{(pid=73503) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG nova.scheduler.client.report [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Inventory has not changed for provider 8044e14a-63b9-43d0-bfb1-d2c0f85cf8a2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73503) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG nova.compute.resource_tracker [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Compute_service record updated for user:user {{(pid=73503) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 14:04:59 user nova-compute[73503]: DEBUG oslo_concurrency.lockutils [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=73503) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 14:05:00 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:01 user nova-compute[73503]: DEBUG oslo_service.periodic_task [None req-d3956437-b12a-4a9d-bbb0-53d16a0999af None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73503) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 14:05:05 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73503) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73503) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 14:05:10 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:14 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:15 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:17 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:20 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:25 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:30 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 14:05:35 user nova-compute[73503]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73503) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}